2020-06-27T04:15:27.028 INFO:root:teuthology version: 1.0.0-ebb68fe 2020-06-27T04:15:27.031 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi/5182928 --name kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi --block --lock -- /tmp/teuthology-worker.pc6kyfe3.tmp 2020-06-27T04:15:27.063 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-27T04:15:27.132 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi/5182928 branch: wip-kefu-testing-2020-06-26-1211 description: rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} email: tchaikov@gmail.com first_in_suite: false job_id: '5182928' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-kefu-testing-2020-06-26-1211 ceph: conf: global: mon client directed command retry: 5 ms bind msgr1: false ms bind msgr2: true ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(OBJECT_ - \(POOL_APP_NOT_ENABLED\) - \(OSD_SLOW_PING_TIME sha1: 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-kefu-testing-2020-06-26-1211 sha1: 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 owner: scheduled_kchai@teuthology priority: 90 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 sha1: 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 sleep_before_teardown: 0 suite: rados suite_branch: wip-kefu-testing-2020-06-26-1211 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-06-26-1211/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 tasks: - install: null - ceph: pre-mgr-commands: - sudo ceph config set mgr mgr/devicehealth/enable_monitoring false --force - divergent_priors2: null teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.8462 2020-06-27T04:15:27.133 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-06-26-1211/qa; will attempt to use it 2020-06-27T04:15:27.134 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-06-26-1211/qa/tasks 2020-06-27T04:15:27.134 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-06-27T04:15:27.143 INFO:teuthology.task.internal:Checking packages... 2020-06-27T04:15:27.175 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5' 2020-06-27T04:15:27.176 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-06-27T04:15:27.176 INFO:teuthology.packaging:ref: None 2020-06-27T04:15:27.177 INFO:teuthology.packaging:tag: None 2020-06-27T04:15:27.177 INFO:teuthology.packaging:branch: wip-kefu-testing-2020-06-26-1211 2020-06-27T04:15:27.178 INFO:teuthology.packaging:sha1: 77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 2020-06-27T04:15:27.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-kefu-testing-2020-06-26-1211 2020-06-27T04:15:27.373 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-2978.g77ddaecfcb0 2020-06-27T04:15:27.373 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-06-27T04:15:27.389 INFO:teuthology.task.internal:no buildpackages task found 2020-06-27T04:15:27.389 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-06-27T04:15:27.412 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-06-27T04:15:27.419 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-27T04:15:27.501 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 1, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi/5182928'} 2020-06-27T04:15:27.528 DEBUG:teuthology.lock.ops:locked ubuntu@smithi017.front.sepia.ceph.com 2020-06-27T04:15:27.603 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb91b695510>, signals=[15]) 2020-06-27T04:15:27.841 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.1 2020-06-27T04:15:28.212 INFO:teuthology.orchestra.console:Power off smithi017 2020-06-27T04:15:28.216 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-06-27T04:15:28.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:15:28.382 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2020-06-27T04:15:28.483 INFO:teuthology.orchestra.console:Power on smithi017 2020-06-27T04:15:28.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-06-27T04:15:28.511 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:15:32.539 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-27T04:15:32.754 INFO:teuthology.orchestra.console:Power on for smithi017 completed 2020-06-27T04:15:32.856 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2020-06-27T04:17:48.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:17:57.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:18:06.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:18:15.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:18:25.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:18:34.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:18:43.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:19:49.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:19:49.538 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-06-27T04:19:49.540 INFO:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-06-27T04:19:49.886 INFO:teuthology.provision.fog.smithi017:Node is ready 2020-06-27T04:19:49.887 INFO:teuthology.orchestra.run.smithi017:> hostname 2020-06-27T04:19:49.902 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2020-06-27T04:19:49.902 INFO:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2020-06-27T04:19:49.957 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2020-06-27T04:19:49.958 INFO:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2020-06-27T04:19:50.071 INFO:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2020-06-27T04:19:50.104 INFO:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2020-06-27T04:19:50.175 INFO:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2020-06-27T04:19:50.246 INFO:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2020-06-27T04:19:50.317 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2020-06-27T04:19:50.318 DEBUG:teuthology.parallel:result is None 2020-06-27T04:19:50.456 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2020-06-27T04:19:50.458 INFO:teuthology.lock.ops:New key found. Updating... 2020-06-27T04:19:50.483 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2020-06-27T04:19:50.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-27T04:19:50.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:19:50.557 INFO:teuthology.orchestra.run.smithi017:> true 2020-06-27T04:19:50.728 INFO:teuthology.orchestra.run.smithi017:> uname -m 2020-06-27T04:19:50.783 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2020-06-27T04:19:50.784 INFO:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2020-06-27T04:19:50.837 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Linux" 2020-06-27T04:19:50.838 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8 (Core)" 2020-06-27T04:19:50.838 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2020-06-27T04:19:50.838 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2020-06-27T04:19:50.839 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8" 2020-06-27T04:19:50.839 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2020-06-27T04:19:50.839 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-06-27T04:19:50.839 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2020-06-27T04:19:50.840 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-06-27T04:19:50.840 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.centos.org/" 2020-06-27T04:19:50.840 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-06-27T04:19:50.840 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:19:50.840 INFO:teuthology.orchestra.run.smithi017.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-06-27T04:19:50.841 INFO:teuthology.orchestra.run.smithi017.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-06-27T04:19:50.841 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-06-27T04:19:50.841 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-06-27T04:19:50.841 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:19:50.843 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2020-06-27T04:19:50.891 INFO:teuthology.task.internal.lock_machines:1 smithi machines locked this try, 1/1 locked so far 2020-06-27T04:19:50.912 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCotL5iamc31FInm2Xo3DzvoJDCv5jtKNxEQJZbnminqxBOg3hYUaCC17Lzi01agfKNENEKqh6sF8F65PkrXK1pZw4pagAVgmacZFJxlDEixDDGxDDTtdcTswMi1/Yz7GKAFsxa5H+YxUMUuds8Hn+jyEXYbyhQPMLV50mVzIymX+bxGdz5eyb2s643xSV/LRsInB07KwfUHoYBqWeD0jSZyXrtZDNCu+X/ZmNo3f1T9hFWvyJxC4oFoauAveOY+tIWbDTgIqBT7ijEOO8lLFK+AvTLKXK1doHa9peJqv7nmWuJOsKx+A6Z7clpAS9l56CoDAlyM++gxNTfsgavzNibGcgy9cDqZjuZw2ooaaONS2zmBuTcn4pcoh2rVFxXt4gc1+LlcoE18R47oeLt2gouzXINxWkhuFB+BOGHA61mksUmb0lfioxuqdJAsOsNXjJYdI1laTbJoVycTEkYTD3WrKbByDV2pOAgHaVF9574IzIa6YQMPfkxVmG9WEK9C08= 2020-06-27T04:19:50.912 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-27T04:19:50.964 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-06-27T04:19:50.989 INFO:teuthology.task.internal:Saving configuration 2020-06-27T04:19:51.006 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-06-27T04:19:51.019 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-06-27T04:19:51.040 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-06-27 04:15:27.513122', 'description': '/home/teuthworker/archive/kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi/5182928', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrcP2pfiCroqGaKJRgmK1he/gTXxlFwHjjAPJMhtkplqP928hyMXEugYlmg6EuYMWi5wRb1dRumRbwZ+hYV2xY=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi017.front.sepia.ceph.com'} 2020-06-27T04:19:51.040 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-06-27T04:19:51.051 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2020-06-27T04:19:51.051 INFO:teuthology.run_tasks:Running task console_log... 2020-06-27T04:19:51.102 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb91f6e5488>, signals=[15]) 2020-06-27T04:19:51.104 INFO:teuthology.run_tasks:Running task internal.connect... 2020-06-27T04:19:51.114 INFO:teuthology.task.internal:Opening connections... 2020-06-27T04:19:51.114 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2020-06-27T04:19:51.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:19:51.192 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-06-27T04:19:51.202 INFO:teuthology.orchestra.run.smithi017:> uname -m 2020-06-27T04:19:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2020-06-27T04:19:51.366 INFO:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2020-06-27T04:19:51.420 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Linux" 2020-06-27T04:19:51.420 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8 (Core)" 2020-06-27T04:19:51.421 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2020-06-27T04:19:51.422 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2020-06-27T04:19:51.423 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8" 2020-06-27T04:19:51.423 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2020-06-27T04:19:51.423 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-06-27T04:19:51.423 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2020-06-27T04:19:51.423 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-06-27T04:19:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.centos.org/" 2020-06-27T04:19:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-06-27T04:19:51.424 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:19:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-06-27T04:19:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-06-27T04:19:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-06-27T04:19:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-06-27T04:19:51.437 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:19:51.437 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2020-06-27T04:19:51.469 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-06-27T04:19:51.509 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-06-27T04:19:51.520 INFO:teuthology.task.internal:Checking for old test directory... 2020-06-27T04:19:51.523 INFO:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2020-06-27T04:19:51.540 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-06-27T04:19:51.550 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-06-27T04:19:51.551 INFO:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2020-06-27T04:19:51.609 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-06-27T04:19:51.643 INFO:teuthology.run_tasks:Running task kernel... 2020-06-27T04:19:51.694 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}} 2020-06-27T04:19:51.696 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-06-27T04:19:51.696 INFO:teuthology.orchestra.run.smithi017:> uname -r 2020-06-27T04:19:51.712 INFO:teuthology.orchestra.run.smithi017.stdout:4.18.0-193.6.3.el8_2.x86_64 2020-06-27T04:19:51.712 INFO:teuthology.task.kernel:Running kernel on smithi017: 4.18.0-193.6.3.el8_2.x86_64 2020-06-27T04:19:51.712 INFO:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2020-06-27T04:19:54.232 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-8 - AppStream 35 MB/s | 7.0 MB 00:00 2020-06-27T04:19:55.491 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-06-27T04:19:55.944 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-8 - Extras 84 kB/s | 5.5 kB 00:00 2020-06-27T04:19:56.087 INFO:teuthology.orchestra.run.smithi017.stdout:Copr repo for ceph-el8 owned by ktdreyer 2.8 kB/s | 257 B 00:00 2020-06-27T04:19:56.642 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 14 MB/s | 7.1 MB 00:00 2020-06-27T04:19:58.191 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 4.0 MB/s | 20 kB 00:00 2020-06-27T04:19:59.304 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-06-27T04:19:59.304 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-4.18.0-193.6.3.el8_2.x86_64 is already installed. 2020-06-27T04:19:59.461 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:19:59.462 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2020-06-27T04:19:59.462 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:19:59.603 INFO:teuthology.orchestra.run.smithi017:> echo no | sudo yum reinstall kernel || true 2020-06-27T04:20:00.031 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:02 ago on Sat 27 Jun 2020 04:19:58 AM UTC. 2020-06-27T04:20:00.281 INFO:teuthology.orchestra.run.smithi017.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-06-27T04:20:00.282 INFO:teuthology.orchestra.run.smithi017.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-06-27T04:20:00.353 INFO:teuthology.orchestra.run.smithi017.stderr:Error: No packages marked for reinstall. 2020-06-27T04:20:00.426 INFO:teuthology.orchestra.run.smithi017:> sudo yum reinstall -y kernel || true 2020-06-27T04:20:00.854 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:02 ago on Sat 27 Jun 2020 04:19:58 AM UTC. 2020-06-27T04:20:01.114 INFO:teuthology.orchestra.run.smithi017.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-06-27T04:20:01.115 INFO:teuthology.orchestra.run.smithi017.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-06-27T04:20:01.161 INFO:teuthology.orchestra.run.smithi017.stderr:Error: No packages marked for reinstall. 2020-06-27T04:20:01.211 INFO:teuthology.orchestra.run.smithi017:> rpm -q kernel --last | head -n 1 2020-06-27T04:20:01.282 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-4.18.0-193.6.3.el8_2.x86_64 Sun 21 Jun 2020 12:15:58 PM UTC 2020-06-27T04:20:01.284 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.6.3.el8_2.x86_64 2020-06-27T04:20:01.284 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-06-27T04:20:01.284 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-06-27T04:20:01.285 INFO:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-06-27T04:20:01.328 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2020-06-27T04:20:01.340 INFO:teuthology.run_tasks:Running task internal.base... 2020-06-27T04:20:01.350 INFO:teuthology.task.internal:Creating test directory... 2020-06-27T04:20:01.350 INFO:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-06-27T04:20:01.394 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-06-27T04:20:01.405 INFO:teuthology.run_tasks:Running task internal.archive... 2020-06-27T04:20:01.419 INFO:teuthology.task.internal:Creating archive directory... 2020-06-27T04:20:01.419 INFO:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-06-27T04:20:01.460 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-06-27T04:20:01.471 INFO:teuthology.task.internal:Enabling coredump saving... 2020-06-27T04:20:01.472 INFO:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-06-27T04:20:01.576 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-27T04:20:01.593 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-27T04:20:01.595 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-06-27T04:20:01.613 INFO:teuthology.task.internal:Configuring sudo... 2020-06-27T04:20:01.614 INFO:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-06-27T04:20:01.651 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-06-27T04:20:01.663 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-06-27T04:20:01.664 INFO:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-06-27T04:20:01.705 INFO:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-06-27T04:20:01.780 INFO:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-06-27T04:20:01.849 INFO:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-06-27T04:20:01.880 INFO:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-06-27T04:20:01.936 INFO:teuthology.orchestra.run.smithi017:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-06-27T04:20:02.020 INFO:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2020-06-27T04:20:02.115 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-06-27T04:20:02.596 INFO:teuthology.run_tasks:Running task internal.timer... 2020-06-27T04:20:02.608 INFO:teuthology.task.internal:Starting timer... 2020-06-27T04:20:02.608 INFO:teuthology.run_tasks:Running task pcp... 2020-06-27T04:20:02.644 INFO:teuthology.run_tasks:Running task selinux... 2020-06-27T04:20:02.657 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-06-27T04:20:02.658 INFO:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2020-06-27T04:20:02.727 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: [ OK ] 2020-06-27T04:20:02.728 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-06-27T04:20:02.729 INFO:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2020-06-27T04:20:02.748 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2020-06-27T04:20:02.748 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive'} 2020-06-27T04:20:02.749 INFO:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-06-27T04:20:02.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-27T04:20:02.821 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-06-27T04:20:02.821 INFO:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2020-06-27T04:20:02.891 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-06-27T04:20:02.903 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-06-27T04:20:02.904 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-06-27T04:20:02.925 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-06-27T04:20:02.927 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-06-27T04:20:03.325 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-06-27T04:20:04.379 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-06-27T04:20:06.904 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-06-27T04:20:06.930 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:06 +0000 (0:00:00.091) 0:00:00.091 ********* 2020-06-27T04:20:09.508 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi017.front.sepia.ceph.com] 2020-06-27T04:20:09.584 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:09 +0000 (0:00:02.653) 0:00:02.745 ********* 2020-06-27T04:20:10.097 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-06-27T04:20:10.099 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-06-27T04:20:10.132 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:10 +0000 (0:00:00.548) 0:00:03.294 ********* 2020-06-27T04:20:10.710 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-06-27T04:20:10.712 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-06-27T04:20:10.751 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:10 +0000 (0:00:00.617) 0:00:03.912 ********* 2020-06-27T04:20:10.782 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:10.826 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:10 +0000 (0:00:00.074) 0:00:03.986 ********* 2020-06-27T04:20:11.327 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-06-27T04:20:11.329 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-27T04:20:11.360 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:11 +0000 (0:00:00.535) 0:00:04.522 ********* 2020-06-27T04:20:12.589 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-06-27T04:20:12.591 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1593231611.3785472-48684038917514/source", "state": "file", "uid": 0} 2020-06-27T04:20:12.625 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:12 +0000 (0:00:01.264) 0:00:05.786 ********* 2020-06-27T04:20:13.107 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2020-06-27T04:20:13.112 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-06-27T04:20:13.224 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-06-27T04:20:13.233 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-06-27T04:20:13.392 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:13 +0000 (0:00:00.766) 0:00:06.553 ********* 2020-06-27T04:20:15.090 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-06-27T04:20:15.091 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] 2020-06-27T04:20:15.169 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-06-27T04:20:15.170 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:15 +0000 (0:00:01.778) 0:00:08.332 ********* 2020-06-27T04:20:15.765 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi017.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.177302", "end": "2020-06-27 04:20:15.732044", "rc": 0, "start": "2020-06-27 04:20:15.554742", "stderr": "", "stderr_lines": [], "stdout": "1fb75ffefa35e7aa6244774f8a516bcfc9e1ef11", "stdout_lines": ["1fb75ffefa35e7aa6244774f8a516bcfc9e1ef11"]} 2020-06-27T04:20:15.807 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:15 +0000 (0:00:00.636) 0:00:08.968 ********* 2020-06-27T04:20:16.060 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010468", "end": "2020-06-27 04:20:16.032456", "failed_when_result": false, "rc": 0, "start": "2020-06-27 04:20:16.021988", "stderr": "", "stderr_lines": [], "stdout": "1fb75ffefa35e7aa6244774f8a516bcfc9e1ef11", "stdout_lines": ["1fb75ffefa35e7aa6244774f8a516bcfc9e1ef11"]} 2020-06-27T04:20:16.110 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:16 +0000 (0:00:00.303) 0:00:09.271 ********* 2020-06-27T04:20:16.151 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-06-27T04:20:16.154 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-06-27T04:20:16.185 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:16 +0000 (0:00:00.075) 0:00:09.347 ********* 2020-06-27T04:20:16.226 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.256 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:16 +0000 (0:00:00.069) 0:00:09.417 ********* 2020-06-27T04:20:16.294 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-06-27T04:20:16.296 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.331 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:16 +0000 (0:00:00.075) 0:00:09.493 ********* 2020-06-27T04:20:16.366 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.421 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:16 +0000 (0:00:00.082) 0:00:09.575 ********* 2020-06-27T04:20:16.445 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.479 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:16 +0000 (0:00:00.065) 0:00:09.640 ********* 2020-06-27T04:20:16.509 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-06-27T04:20:16.518 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.542 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:16 +0000 (0:00:00.063) 0:00:09.704 ********* 2020-06-27T04:20:16.605 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-06-27T04:20:16.606 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.623 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.628 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.631 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841e 2020-06-27T04:20:16.634 INFO:teuthology.task.ansible.out:e62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.640 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.641 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.652 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.654 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.663 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.665 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.676 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.691 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ub 2020-06-27T04:20:16.695 INFO:teuthology.task.ansible.out:untu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.699 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.702 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.711 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.721 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.724 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.727 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.749 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce66 2020-06-27T04:20:16.752 INFO:teuthology.task.ansible.out:8079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.758 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.769 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.773 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.781 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.783 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.793 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.804 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.806 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.815 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.818 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.827 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.831 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.839 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.841 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.850 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.852 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.863 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.873 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.882 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.884 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.886 INFO:teuthology.task.ansible.out: skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.896 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.898 INFO:teuthology.task.ansible.out: skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.909 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.910 INFO:teuthology.task.ansible.out: 2020-06-27T04:20:16.932 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.934 INFO:teuthology.task.ansible.out: skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.936 INFO:teuthology.task.ansible.out: skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.947 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.948 INFO:teuthology.task.ansible.out: skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.959 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.961 INFO:teuthology.task.ansible.out: skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.972 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.978 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.982 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.984 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:16.999 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.004 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.006 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.016 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.019 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.028 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.050 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.052 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.053 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.054 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.055 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.057 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.058 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.061 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.073 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.075 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.084 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.086 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.102 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.104 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.114 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.116 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.134 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.144 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.145 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.156 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.158 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.167 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.169 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.180 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.194 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.220 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.225 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.242 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.287 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:17 +0000 (0:00:00.743) 0:00:10.448 ********* 2020-06-27T04:20:17.347 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-06-27T04:20:17.380 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:17 +0000 (0:00:00.093) 0:00:10.541 ********* 2020-06-27T04:20:17.410 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-06-27T04:20:17.412 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.451 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:17 +0000 (0:00:00.071) 0:00:10.612 ********* 2020-06-27T04:20:17.494 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-06-27T04:20:17.495 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.528 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:17 +0000 (0:00:00.076) 0:00:10.689 ********* 2020-06-27T04:20:17.570 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.603 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:17 +0000 (0:00:00.075) 0:00:10.765 ********* 2020-06-27T04:20:17.647 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.692 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:17 +0000 (0:00:00.088) 0:00:10.853 ********* 2020-06-27T04:20:17.723 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-06-27T04:20:17.725 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.773 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:17 +0000 (0:00:00.081) 0:00:10.935 ********* 2020-06-27T04:20:17.828 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-27T04:20:17.830 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.839 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.840 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.850 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.852 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.861 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.863 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.873 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.875 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.884 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.886 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.897 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.899 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.910 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.911 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.921 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.923 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.935 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.953 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.955 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.965 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.967 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.976 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.978 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.988 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:17.989 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:18.015 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:18.017 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:18.037 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:18.045 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:18.094 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:18 +0000 (0:00:00.321) 0:00:11.256 ********* 2020-06-27T04:20:18.858 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-06-27T04:20:18.860 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "4f13f291a93b37bba6a159b6c4f0dc6d6479e734", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-06-27T04:20:18.902 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:18 +0000 (0:00:00.808) 0:00:12.064 ********* 2020-06-27T04:20:18.945 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi017.front.sepia.ceph.com] => { "msg": "Host smithi017.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-06-27T04:20:18.992 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:18 +0000 (0:00:00.089) 0:00:12.154 ********* 2020-06-27T04:20:19.036 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-06-27T04:20:19.037 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-06-27T04:20:19.087 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:19 +0000 (0:00:00.095) 0:00:12.249 ********* 2020-06-27T04:20:19.119 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:19.157 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:19 +0000 (0:00:00.069) 0:00:12.318 ********* 2020-06-27T04:20:19.709 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-06-27T04:20:19.711 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.320158", "end": "2020-06-27 04:20:19.681535", "rc": 0, "start": "2020-06-27 04:20:19.361377", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-06-27T04:20:19.750 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:19 +0000 (0:00:00.587) 0:00:12.906 ********* 2020-06-27T04:20:19.785 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-06-27T04:20:19.787 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:19.820 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:19 +0000 (0:00:00.075) 0:00:12.981 ********* 2020-06-27T04:20:19.862 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-06-27T04:20:19.864 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:19.897 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:19 +0000 (0:00:00.077) 0:00:13.059 ********* 2020-06-27T04:20:19.933 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-06-27T04:20:19.935 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:19.969 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:19 +0000 (0:00:00.071) 0:00:13.130 ********* 2020-06-27T04:20:20.014 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-06-27T04:20:20.015 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:20.049 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:20 +0000 (0:00:00.079) 0:00:13.210 ********* 2020-06-27T04:20:20.080 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-06-27T04:20:20.082 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:20.116 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:20 +0000 (0:00:00.067) 0:00:13.278 ********* 2020-06-27T04:20:20.157 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-06-27T04:20:20.158 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:20.197 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:20 +0000 (0:00:00.080) 0:00:13.358 ********* 2020-06-27T04:20:20.264 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-06-27T04:20:20.266 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:20:20.300 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:20 +0000 (0:00:00.103) 0:00:13.462 ********* 2020-06-27T04:20:20.345 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-06-27T04:20:20.347 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:20.383 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:20 +0000 (0:00:00.082) 0:00:13.545 ********* 2020-06-27T04:20:20.442 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:20.485 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:20 +0000 (0:00:00.101) 0:00:13.647 ********* 2020-06-27T04:20:20.535 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-06-27T04:20:20.537 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:20:20.572 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:20 +0000 (0:00:00.086) 0:00:13.733 ********* 2020-06-27T04:20:20.612 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-06-27T04:20:20.614 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:20.651 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:20 +0000 (0:00:00.079) 0:00:13.812 ********* 2020-06-27T04:20:20.702 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-06-27T04:20:20.703 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:20:20.739 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:20 +0000 (0:00:00.087) 0:00:13.900 ********* 2020-06-27T04:20:20.779 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-06-27T04:20:20.781 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:20.816 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:20 +0000 (0:00:00.077) 0:00:13.978 ********* 2020-06-27T04:20:20.849 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-06-27T04:20:20.851 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:20.885 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:20 +0000 (0:00:00.068) 0:00:14.046 ********* 2020-06-27T04:20:20.915 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-06-27T04:20:20.917 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:20.954 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:20 +0000 (0:00:00.068) 0:00:14.115 ********* 2020-06-27T04:20:20.995 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-06-27T04:20:20.998 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:21.032 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:21 +0000 (0:00:00.075) 0:00:14.191 ********* 2020-06-27T04:20:21.062 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:20:21.102 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:21 +0000 (0:00:00.068) 0:00:14.259 ********* 2020-06-27T04:20:21.138 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-06-27T04:20:21.140 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:21.173 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:21 +0000 (0:00:00.075) 0:00:14.335 ********* 2020-06-27T04:20:21.222 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:21.259 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:21 +0000 (0:00:00.085) 0:00:14.420 ********* 2020-06-27T04:20:21.295 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-06-27T04:20:21.297 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:21.329 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:21 +0000 (0:00:00.070) 0:00:14.491 ********* 2020-06-27T04:20:21.362 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:21.397 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:21 +0000 (0:00:00.067) 0:00:14.558 ********* 2020-06-27T04:20:21.429 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-06-27T04:20:21.431 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:21.475 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:21 +0000 (0:00:00.069) 0:00:14.628 ********* 2020-06-27T04:20:21.507 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:21.545 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:21 +0000 (0:00:00.079) 0:00:14.707 ********* 2020-06-27T04:20:21.547 INFO:teuthology.task.ansible.out: 2020-06-27T04:20:21.587 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-06-27T04:20:21.589 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-27T04:20:21.624 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:21 +0000 (0:00:00.078) 0:00:14.786 ********* 2020-06-27T04:20:21.664 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-06-27T04:20:21.666 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:21.704 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:21 +0000 (0:00:00.076) 0:00:14.862 ********* 2020-06-27T04:20:21.741 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-06-27T04:20:21.744 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:21.776 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:21 +0000 (0:00:00.076) 0:00:14.938 ********* 2020-06-27T04:20:22.036 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-06-27T04:20:22.038 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-27T04:20:22.076 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:22 +0000 (0:00:00.299) 0:00:15.237 ********* 2020-06-27T04:20:22.663 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi017.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-06-27T04:20:23.240 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-06-27T04:20:23.277 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:23 +0000 (0:00:01.201) 0:00:16.439 ********* 2020-06-27T04:20:23.846 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-06-27T04:20:23.849 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-06-27T04:20:24.364 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-06-27T04:20:24.405 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:24 +0000 (0:00:01.128) 0:00:17.567 ********* 2020-06-27T04:20:24.446 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-06-27T04:20:24.448 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:24.481 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:24 +0000 (0:00:00.075) 0:00:17.642 ********* 2020-06-27T04:20:24.521 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-06-27T04:20:24.523 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:24.555 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:24 +0000 (0:00:00.074) 0:00:17.717 ********* 2020-06-27T04:20:24.585 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-06-27T04:20:24.586 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:24.620 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:24 +0000 (0:00:00.065) 0:00:17.782 ********* 2020-06-27T04:20:24.650 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-06-27T04:20:24.652 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:24.685 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:24 +0000 (0:00:00.064) 0:00:17.847 ********* 2020-06-27T04:20:24.719 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-06-27T04:20:24.721 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:24.757 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:24 +0000 (0:00:00.071) 0:00:17.919 ********* 2020-06-27T04:20:24.799 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-06-27T04:20:24.801 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:24.832 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:24 +0000 (0:00:00.074) 0:00:17.994 ********* 2020-06-27T04:20:24.873 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-06-27T04:20:24.875 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:24.907 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:24 +0000 (0:00:00.074) 0:00:18.069 ********* 2020-06-27T04:20:24.939 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:24.973 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:24 +0000 (0:00:00.065) 0:00:18.134 ********* 2020-06-27T04:20:25.003 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-06-27T04:20:25.005 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:25.038 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:25 +0000 (0:00:00.065) 0:00:18.199 ********* 2020-06-27T04:20:25.525 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.272314", "end": "2020-06-27 04:20:25.500363", "rc": 0, "start": "2020-06-27 04:20:25.228049", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:20:25.564 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:25 +0000 (0:00:00.525) 0:00:18.725 ********* 2020-06-27T04:20:26.908 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-06-27T04:20:26.945 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:26 +0000 (0:00:01.381) 0:00:20.106 ********* 2020-06-27T04:20:26.978 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-06-27T04:20:26.984 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:27.023 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:27 +0000 (0:00:00.078) 0:00:20.185 ********* 2020-06-27T04:20:27.059 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-06-27T04:20:27.060 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:27.097 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:27 +0000 (0:00:00.073) 0:00:20.259 ********* 2020-06-27T04:20:27.130 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-06-27T04:20:27.132 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:27.165 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:27 +0000 (0:00:00.067) 0:00:20.327 ********* 2020-06-27T04:20:27.206 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-06-27T04:20:27.208 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:27.241 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:27 +0000 (0:00:00.075) 0:00:20.402 ********* 2020-06-27T04:20:27.781 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-06-27T04:20:27.815 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:27 +0000 (0:00:00.573) 0:00:20.976 ********* 2020-06-27T04:20:28.908 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-06-27T04:20:28.910 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-06-27T04:20:28.942 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:28 +0000 (0:00:01.127) 0:00:22.104 ********* 2020-06-27T04:20:29.515 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-06-27T04:20:29.520 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-06-27T04:20:30.013 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-06-27T04:20:30.496 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-06-27T04:20:30.536 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:30 +0000 (0:00:01.594) 0:00:23.698 ********* 2020-06-27T04:20:30.756 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-06-27T04:20:30.758 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-27T04:20:30.807 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:30 +0000 (0:00:00.270) 0:00:23.968 ********* 2020-06-27T04:20:31.345 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi017.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-06-27T04:20:31.835 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-06-27T04:20:32.323 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-06-27T04:20:32.359 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:32 +0000 (0:00:01.552) 0:00:25.521 ********* 2020-06-27T04:20:32.389 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-06-27T04:20:32.391 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:32.430 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:32 +0000 (0:00:00.071) 0:00:25.592 ********* 2020-06-27T04:20:32.481 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-06-27T04:20:32.483 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-06-27T04:20:32.520 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:32 +0000 (0:00:00.089) 0:00:25.681 ********* 2020-06-27T04:20:32.739 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi017.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-06-27T04:20:32.774 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:32 +0000 (0:00:00.254) 0:00:25.936 ********* 2020-06-27T04:20:32.838 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-06-27T04:20:32.840 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:32.850 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:32.861 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:32.907 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:32 +0000 (0:00:00.132) 0:00:26.068 ********* 2020-06-27T04:20:33.874 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-06-27T04:20:33.876 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-06-27T04:20:33.908 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:33 +0000 (0:00:01.001) 0:00:27.070 ********* 2020-06-27T04:20:33.961 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-06-27T04:20:33.963 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:33.996 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:33 +0000 (0:00:00.087) 0:00:27.157 ********* 2020-06-27T04:20:34.537 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-06-27T04:20:34.539 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-06-27T04:20:34.573 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:34 +0000 (0:00:00.576) 0:00:27.734 ********* 2020-06-27T04:20:35.117 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-06-27T04:20:35.118 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-06-27T04:20:35.171 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:35 +0000 (0:00:00.597) 0:00:28.332 ********* 2020-06-27T04:20:35.226 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-06-27T04:20:35.228 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-06-27T04:20:35.264 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:35 +0000 (0:00:00.093) 0:00:28.426 ********* 2020-06-27T04:20:35.511 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi017.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-27T04:20:35.552 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:35 +0000 (0:00:00.283) 0:00:28.709 ********* 2020-06-27T04:20:35.832 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi017.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-06-27T04:20:35.874 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:35 +0000 (0:00:00.326) 0:00:29.035 ********* 2020-06-27T04:20:35.875 INFO:teuthology.task.ansible.out: 2020-06-27T04:20:35.918 INFO:teuthology.task.ansible.out: 2020-06-27T04:20:35.920 INFO:teuthology.task.ansible.out:TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:20:35.956 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:35 +0000 (0:00:00.082) 0:00:29.118 ********* 2020-06-27T04:20:35.958 INFO:teuthology.task.ansible.out: 2020-06-27T04:20:36.497 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-06-27T04:20:36.499 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-06-27T04:20:36.532 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:36 +0000 (0:00:00.575) 0:00:29.694 ********* 2020-06-27T04:20:37.387 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-06-27T04:20:37.388 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-06-27 04:19:16 UTC", "ActiveEnterTimestampMonotonic": "19924220", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount sysinit.target basic.target time-sync.target var-run.mount systemd-tmpfiles-setup.service network.target system.slice local-fs.target -.mount systemd-journald.socket nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-06-27 04:19:16 UTC", "AssertTimestampMonotonic": "19923534", "Before": "plymouth-quit.service getty@tty1.service multi-user.target xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-06-27 04:19:16 UTC", "ConditionTimestampMonotonic": "19923534", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-06-27T04:20:37.390 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2504", "ExecMainStartTimestamp": "Sat 2020-06-27 04:19:16 UTC", "ExecMainStartTimestampMonotonic": "19924192", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Sat 2020-06-27 04:19:16 UTC] ; stop_time=[n/a] ; pid=2504 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-06-27 04:19:16 UTC", "InactiveExitTimestampMonotonic": "19924220", "InvocationID": "0328b8483b5d4fb881330bbf263fba96", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-06-27T04:20:37.391 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2504", "MemoryAccounting": "yes", "MemoryCurrent": "1146880", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-06-27T04:20:37.393 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-06-27 04:19:16 UTC", "StateChangeTimestampMonotonic": "19924220", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-06-27 04:19:16 UTC", "WatchdogTimestampMonotonic": "19924219", "WatchdogUSec": "0"}} 2020-06-27T04:20:37.448 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:37 +0000 (0:00:00.916) 0:00:30.610 ********* 2020-06-27T04:20:37.668 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-06-27T04:20:37.669 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001760", "end": "2020-06-27 04:20:37.642563", "rc": 0, "start": "2020-06-27 04:20:37.640803", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-06-27T04:20:37.707 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:37 +0000 (0:00:00.258) 0:00:30.868 ********* 2020-06-27T04:20:37.709 INFO:teuthology.task.ansible.out: 2020-06-27T04:20:38.674 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-06-27T04:20:38.676 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-06-27T04:20:38.718 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:38 +0000 (0:00:01.011) 0:00:31.879 ********* 2020-06-27T04:20:39.691 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-06-27T04:20:39.693 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-06-27T04:20:39.732 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:39 +0000 (0:00:01.013) 0:00:32.893 ********* 2020-06-27T04:20:41.184 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-06-27T04:20:41.186 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-06-27T04:20:41.220 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:41 +0000 (0:00:01.487) 0:00:34.381 ********* 2020-06-27T04:20:58.321 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-06-27T04:20:58.329 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.881403", "end": "2020-06-27 04:20:58.292651", "failed_when_result": false, "rc": 0, "start": "2020-06-27 04:20:41.411248", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-06-27T04:20:58.358 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:58 +0000 (0:00:17.138) 0:00:51.520 ********* 2020-06-27T04:20:58.908 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-06-27T04:20:58.910 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-06-27T04:20:58.943 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:58 +0000 (0:00:00.584) 0:00:52.104 ********* 2020-06-27T04:20:59.170 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013469", "end": "2020-06-27 04:20:59.147530", "rc": 0, "start": "2020-06-27 04:20:59.134061", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:20:59.205 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:59 +0000 (0:00:00.262) 0:00:52.367 ********* 2020-06-27T04:20:59.432 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-06-27T04:20:59.434 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.008755", "end": "2020-06-27 04:20:59.408712", "rc": 0, "start": "2020-06-27 04:20:59.399957", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:20:59.468 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:20:59 +0000 (0:00:00.262) 0:00:52.630 ********* 2020-06-27T04:21:16.448 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-06-27T04:21:16.450 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.758790", "end": "2020-06-27 04:21:16.421298", "rc": 0, "start": "2020-06-27 04:20:59.662508", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:21:16.495 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:16 +0000 (0:00:17.026) 0:01:09.656 ********* 2020-06-27T04:21:16.726 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-06-27T04:21:16.728 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-06-27T04:21:16.763 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:16 +0000 (0:00:00.268) 0:01:09.925 ********* 2020-06-27T04:21:16.810 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-06-27T04:21:16.811 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-06-27T04:21:16.847 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:16 +0000 (0:00:00.084) 0:01:10.009 ********* 2020-06-27T04:21:16.898 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-06-27T04:21:16.901 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-06-27T04:21:16.941 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:16 +0000 (0:00:00.093) 0:01:10.103 ********* 2020-06-27T04:21:16.983 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-06-27T04:21:16.986 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-06-27T04:21:17.019 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:17 +0000 (0:00:00.077) 0:01:10.181 ********* 2020-06-27T04:21:17.072 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-06-27T04:21:17.074 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-06-27T04:21:17.111 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:17 +0000 (0:00:00.092) 0:01:10.273 ********* 2020-06-27T04:21:17.331 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-06-27T04:21:17.333 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-06-27T04:21:17.367 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:17 +0000 (0:00:00.254) 0:01:10.528 ********* 2020-06-27T04:21:17.583 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-06-27T04:21:17.585 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "gid": 1220, "name": "ubuntu", "state": "present", "system": false} 2020-06-27T04:21:17.620 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:17 +0000 (0:00:00.253) 0:01:10.782 ********* 2020-06-27T04:21:17.651 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-06-27T04:21:17.653 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:17.692 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:17 +0000 (0:00:00.071) 0:01:10.853 ********* 2020-06-27T04:21:17.724 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:17.765 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:17 +0000 (0:00:00.073) 0:01:10.927 ********* 2020-06-27T04:21:18.012 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-06-27T04:21:18.014 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-06-27T04:21:18.045 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:18 +0000 (0:00:00.280) 0:01:11.207 ********* 2020-06-27T04:21:18.650 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-06-27T04:21:18.651 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-06-27T04:21:18.690 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:18 +0000 (0:00:00.644) 0:01:11.851 ********* 2020-06-27T04:21:18.730 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-06-27T04:21:18.734 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi017"}, "changed": false} 2020-06-27T04:21:18.776 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:18 +0000 (0:00:00.086) 0:01:11.938 ********* 2020-06-27T04:21:19.913 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-06-27T04:21:19.915 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi017", "ansible_hostname": "smithi017", "ansible_nodename": "smithi017"}, "changed": false, "name": "smithi017"} 2020-06-27T04:21:19.956 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:19 +0000 (0:00:01.179) 0:01:13.117 ********* 2020-06-27T04:21:20.503 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-06-27T04:21:20.505 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-06-27T04:21:20.542 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:20 +0000 (0:00:00.585) 0:01:13.703 ********* 2020-06-27T04:21:21.065 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-06-27T04:21:21.067 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-06-27T04:21:21.099 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:21 +0000 (0:00:00.557) 0:01:14.261 ********* 2020-06-27T04:21:21.745 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi017.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-06-27T04:21:21.784 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:21 +0000 (0:00:00.684) 0:01:14.945 ********* 2020-06-27T04:21:22.316 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-06-27T04:21:22.353 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:22 +0000 (0:00:00.569) 0:01:15.515 ********* 2020-06-27T04:21:22.587 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-06-27T04:21:22.589 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-06-27T04:21:22.622 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:22 +0000 (0:00:00.268) 0:01:15.784 ********* 2020-06-27T04:21:22.840 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-06-27T04:21:22.842 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-06-27T04:21:22.877 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:22 +0000 (0:00:00.254) 0:01:16.038 ********* 2020-06-27T04:21:23.118 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-06-27T04:21:23.120 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1220, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-06-27T04:21:23.154 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:23 +0000 (0:00:00.277) 0:01:16.316 ********* 2020-06-27T04:21:23.712 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-06-27T04:21:23.714 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-06-27T04:21:23.754 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:23 +0000 (0:00:00.599) 0:01:16.916 ********* 2020-06-27T04:21:24.295 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-06-27T04:21:24.331 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:24 +0000 (0:00:00.576) 0:01:17.492 ********* 2020-06-27T04:21:26.412 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-06-27T04:21:26.414 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.859265", "end": "2020-06-27 04:21:26.383948", "rc": 0, "start": "2020-06-27 04:21:24.524683", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:21:26.447 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:26 +0000 (0:00:02.116) 0:01:19.609 ********* 2020-06-27T04:21:27.003 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-06-27T04:21:27.005 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-06-27T04:21:27.505 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-06-27T04:21:28.040 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-06-27T04:21:28.094 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:28 +0000 (0:00:01.641) 0:01:21.250 ********* 2020-06-27T04:21:28.648 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-06-27T04:21:28.651 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-06-27T04:21:28.685 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:28 +0000 (0:00:00.596) 0:01:21.846 ********* 2020-06-27T04:21:29.235 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-06-27T04:21:29.237 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-06-27T04:21:29.774 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-06-27T04:21:30.277 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-06-27T04:21:30.314 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:30 +0000 (0:00:01.629) 0:01:23.476 ********* 2020-06-27T04:21:30.902 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** changed: [smithi017.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.347068", "end": "2020-06-27 04:21:30.874190", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-06-27 04:21:30.527122", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-06-27T04:21:30.904 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-06-27T04:21:30.940 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:30 +0000 (0:00:00.625) 0:01:24.101 ********* 2020-06-27T04:21:30.976 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-06-27T04:21:30.978 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:31.013 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:31 +0000 (0:00:00.073) 0:01:24.175 ********* 2020-06-27T04:21:31.064 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-06-27T04:21:31.066 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-06-27T04:21:31.076 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-06-27T04:21:31.133 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:31 +0000 (0:00:00.119) 0:01:24.295 ********* 2020-06-27T04:21:31.178 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-06-27T04:21:31.180 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:31.218 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:31 +0000 (0:00:00.084) 0:01:24.379 ********* 2020-06-27T04:21:31.265 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:21:31.267 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-06-27T04:21:31.304 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:31 +0000 (0:00:00.086) 0:01:24.465 ********* 2020-06-27T04:21:31.346 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-06-27T04:21:31.348 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:31.388 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:31 +0000 (0:00:00.084) 0:01:24.549 ********* 2020-06-27T04:21:31.428 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-06-27T04:21:31.430 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:31.463 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:31 +0000 (0:00:00.075) 0:01:24.625 ********* 2020-06-27T04:21:31.697 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-06-27T04:21:31.699 INFO:teuthology.task.ansible.out:fatal: [smithi017.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007008", "end": "2020-06-27 04:21:31.673937", "msg": "non-zero return code", "rc": 1, "start": "2020-06-27 04:21:31.666929", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-06-27T04:21:31.732 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:31 +0000 (0:00:00.269) 0:01:24.894 ********* 2020-06-27T04:21:31.764 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-06-27T04:21:31.766 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:31.811 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:31 +0000 (0:00:00.079) 0:01:24.973 ********* 2020-06-27T04:21:34.358 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-06-27T04:21:34.360 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-06-27T04:21:34.391 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:34 +0000 (0:00:02.580) 0:01:27.553 ********* 2020-06-27T04:21:36.445 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-06-27T04:21:36.446 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-06-27T04:21:36.482 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:36 +0000 (0:00:02.090) 0:01:29.644 ********* 2020-06-27T04:21:39.651 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-27T04:21:39.654 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-06-27T04:21:39.685 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:39 +0000 (0:00:03.202) 0:01:32.846 ********* 2020-06-27T04:21:39.727 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-06-27T04:21:39.728 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:39.764 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:39 +0000 (0:00:00.079) 0:01:32.926 ********* 2020-06-27T04:21:40.748 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-06-27T04:21:40.782 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:40 +0000 (0:00:01.017) 0:01:33.943 ********* 2020-06-27T04:21:40.829 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:40.874 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:40 +0000 (0:00:00.091) 0:01:34.035 ********* 2020-06-27T04:21:41.228 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-06-27T04:21:41.230 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice dbus.service dbus.socket sysinit.target basic.target polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service shutdown.target ipset.service ebtables.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-06-27T04:21:41.232 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", 2020-06-27T04:21:41.233 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-06-27T04:21:41.235 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-06-27T04:21:41.270 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:41 +0000 (0:00:00.396) 0:01:34.432 ********* 2020-06-27T04:21:41.597 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-06-27T04:21:41.609 INFO:teuthology.task.ansible.out:fatal: [smithi017.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-06-27T04:21:41.632 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:41 +0000 (0:00:00.362) 0:01:34.794 ********* 2020-06-27T04:21:42.421 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-06-27T04:21:42.423 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-06-27T04:21:42.467 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:42 +0000 (0:00:00.834) 0:01:35.628 ********* 2020-06-27T04:21:42.508 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-06-27T04:21:42.509 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:42.550 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:42 +0000 (0:00:00.083) 0:01:35.712 ********* 2020-06-27T04:21:42.595 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-06-27T04:21:42.598 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:42.630 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:42 +0000 (0:00:00.079) 0:01:35.791 ********* 2020-06-27T04:21:42.671 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-06-27T04:21:42.673 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:42.709 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:42 +0000 (0:00:00.079) 0:01:35.871 ********* 2020-06-27T04:21:42.750 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:42.785 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:42 +0000 (0:00:00.076) 0:01:35.947 ********* 2020-06-27T04:21:42.827 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-06-27T04:21:42.829 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:42.863 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:42 +0000 (0:00:00.077) 0:01:36.024 ********* 2020-06-27T04:21:42.893 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-06-27T04:21:42.895 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:42.933 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:42 +0000 (0:00:00.070) 0:01:36.095 ********* 2020-06-27T04:21:42.963 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-06-27T04:21:43.003 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.070) 0:01:36.165 ********* 2020-06-27T04:21:43.033 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-06-27T04:21:43.035 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.077 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.073) 0:01:36.238 ********* 2020-06-27T04:21:43.109 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-06-27T04:21:43.111 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.146 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.067) 0:01:36.305 ********* 2020-06-27T04:21:43.184 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi017.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.186 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.222 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.074) 0:01:36.380 ********* 2020-06-27T04:21:43.248 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-06-27T04:21:43.250 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.282 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.063) 0:01:36.444 ********* 2020-06-27T04:21:43.313 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-06-27T04:21:43.347 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.064) 0:01:36.508 ********* 2020-06-27T04:21:43.378 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-06-27T04:21:43.380 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.412 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.065) 0:01:36.574 ********* 2020-06-27T04:21:43.456 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.495 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.082) 0:01:36.656 ********* 2020-06-27T04:21:43.527 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-06-27T04:21:43.528 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.564 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.068) 0:01:36.725 ********* 2020-06-27T04:21:43.565 INFO:teuthology.task.ansible.out: 2020-06-27T04:21:43.605 INFO:teuthology.task.ansible.out: 2020-06-27T04:21:43.611 INFO:teuthology.task.ansible.out:TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.651 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.087) 0:01:36.813 ********* 2020-06-27T04:21:43.684 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-06-27T04:21:43.686 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.727 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.075) 0:01:36.888 ********* 2020-06-27T04:21:43.762 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-27T04:21:43.764 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.798 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.071) 0:01:36.960 ********* 2020-06-27T04:21:43.828 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-06-27T04:21:43.830 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.873 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.074) 0:01:37.035 ********* 2020-06-27T04:21:43.921 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-06-27T04:21:43.923 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:43.956 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:43 +0000 (0:00:00.082) 0:01:37.118 ********* 2020-06-27T04:21:43.987 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-06-27T04:21:43.989 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.021 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.065) 0:01:37.183 ********* 2020-06-27T04:21:44.056 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-06-27T04:21:44.058 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.091 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.069) 0:01:37.252 ********* 2020-06-27T04:21:44.120 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-06-27T04:21:44.122 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.156 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.065) 0:01:37.318 ********* 2020-06-27T04:21:44.186 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-06-27T04:21:44.187 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.220 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.063) 0:01:37.381 ********* 2020-06-27T04:21:44.261 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-06-27T04:21:44.262 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.294 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.074) 0:01:37.456 ********* 2020-06-27T04:21:44.325 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-06-27T04:21:44.327 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.360 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.065) 0:01:37.521 ********* 2020-06-27T04:21:44.399 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-06-27T04:21:44.401 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.442 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.081) 0:01:37.603 ********* 2020-06-27T04:21:44.486 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-06-27T04:21:44.488 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.526 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.084) 0:01:37.688 ********* 2020-06-27T04:21:44.560 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-06-27T04:21:44.562 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.600 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.074) 0:01:37.762 ********* 2020-06-27T04:21:44.631 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-06-27T04:21:44.633 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.670 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.069) 0:01:37.831 ********* 2020-06-27T04:21:44.701 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.735 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.065) 0:01:37.897 ********* 2020-06-27T04:21:44.777 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.817 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.082) 0:01:37.979 ********* 2020-06-27T04:21:44.848 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-06-27T04:21:44.850 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.886 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.068) 0:01:38.047 ********* 2020-06-27T04:21:44.926 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-06-27T04:21:44.928 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:44.962 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:44 +0000 (0:00:00.075) 0:01:38.123 ********* 2020-06-27T04:21:44.998 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:21:45.000 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:45.034 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:45 +0000 (0:00:00.071) 0:01:38.195 ********* 2020-06-27T04:21:45.064 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-06-27T04:21:45.066 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:45.101 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:45 +0000 (0:00:00.067) 0:01:38.263 ********* 2020-06-27T04:21:45.133 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-27T04:21:45.135 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:45.170 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:45 +0000 (0:00:00.065) 0:01:38.328 ********* 2020-06-27T04:21:45.198 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-27T04:21:45.200 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:45.239 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:45 +0000 (0:00:00.073) 0:01:38.401 ********* 2020-06-27T04:21:45.271 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-06-27T04:21:45.273 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:45.308 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:45 +0000 (0:00:00.068) 0:01:38.469 ********* 2020-06-27T04:21:45.559 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-27T04:21:45.561 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-06-27T04:21:45.601 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:45 +0000 (0:00:00.291) 0:01:38.761 ********* 2020-06-27T04:21:45.938 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-27T04:21:45.940 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-27T04:21:45.974 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:45 +0000 (0:00:00.373) 0:01:39.135 ********* 2020-06-27T04:21:46.216 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-27T04:21:46.218 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-06-27T04:21:46.257 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:46 +0000 (0:00:00.283) 0:01:39.419 ********* 2020-06-27T04:21:46.288 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-06-27T04:21:46.290 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:46.333 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:46 +0000 (0:00:00.075) 0:01:39.494 ********* 2020-06-27T04:21:46.379 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:46.419 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:46 +0000 (0:00:00.086) 0:01:39.581 ********* 2020-06-27T04:21:46.450 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:46.484 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:46 +0000 (0:00:00.064) 0:01:39.645 ********* 2020-06-27T04:21:46.523 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-27T04:21:46.525 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:46.558 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:46 +0000 (0:00:00.074) 0:01:39.720 ********* 2020-06-27T04:21:46.588 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-27T04:21:46.590 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:46.623 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:46 +0000 (0:00:00.065) 0:01:39.785 ********* 2020-06-27T04:21:46.654 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:46.688 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:46 +0000 (0:00:00.065) 0:01:39.850 ********* 2020-06-27T04:21:46.731 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:46.767 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:46 +0000 (0:00:00.078) 0:01:39.928 ********* 2020-06-27T04:21:46.799 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-27T04:21:46.800 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:46.837 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:46 +0000 (0:00:00.070) 0:01:39.998 ********* 2020-06-27T04:21:46.878 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-27T04:21:46.880 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:46.922 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:46 +0000 (0:00:00.085) 0:01:40.084 ********* 2020-06-27T04:21:46.964 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-06-27T04:21:46.966 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.000 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:46 +0000 (0:00:00.077) 0:01:40.161 ********* 2020-06-27T04:21:47.052 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-06-27T04:21:47.054 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.090 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.090) 0:01:40.252 ********* 2020-06-27T04:21:47.131 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-06-27T04:21:47.132 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.167 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.076) 0:01:40.328 ********* 2020-06-27T04:21:47.197 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-27T04:21:47.199 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.237 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.070) 0:01:40.398 ********* 2020-06-27T04:21:47.267 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-06-27T04:21:47.268 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.306 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.068) 0:01:40.467 ********* 2020-06-27T04:21:47.352 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-06-27T04:21:47.354 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.390 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.080) 0:01:40.547 ********* 2020-06-27T04:21:47.428 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-06-27T04:21:47.429 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.475 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.089) 0:01:40.636 ********* 2020-06-27T04:21:47.505 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-06-27T04:21:47.507 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.547 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.072) 0:01:40.709 ********* 2020-06-27T04:21:47.589 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.621 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.073) 0:01:40.782 ********* 2020-06-27T04:21:47.654 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-06-27T04:21:47.656 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.693 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.072) 0:01:40.855 ********* 2020-06-27T04:21:47.724 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-06-27T04:21:47.726 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.763 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.069) 0:01:40.925 ********* 2020-06-27T04:21:47.798 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-06-27T04:21:47.800 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.834 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.071) 0:01:40.996 ********* 2020-06-27T04:21:47.866 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-06-27T04:21:47.868 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:47.902 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.068) 0:01:41.064 ********* 2020-06-27T04:21:47.954 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:21:47.955 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-06-27T04:21:47.989 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:47 +0000 (0:00:00.086) 0:01:41.150 ********* 2020-06-27T04:21:48.040 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-06-27T04:21:48.042 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-06-27T04:21:48.051 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-06-27T04:21:48.053 INFO:teuthology.task.ansible.out: skipping: [smithi017.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-06-27T04:21:48.062 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-06-27T04:21:48.073 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-06-27T04:21:48.074 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-06-27T04:21:48.074 INFO:teuthology.task.ansible.out: 2020-06-27T04:21:48.086 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-06-27T04:21:48.127 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:48 +0000 (0:00:00.137) 0:01:41.288 ********* 2020-06-27T04:21:48.362 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-06-27T04:21:48.364 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004359", "end": "2020-06-27 04:21:48.336842", "rc": 0, "start": "2020-06-27 04:21:48.332483", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-06-27T04:21:48.405 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:48 +0000 (0:00:00.278) 0:01:41.567 ********* 2020-06-27T04:21:48.440 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:48.482 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:48 +0000 (0:00:00.076) 0:01:41.643 ********* 2020-06-27T04:21:48.523 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-06-27T04:21:48.525 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:48.570 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:48 +0000 (0:00:00.088) 0:01:41.732 ********* 2020-06-27T04:21:48.633 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:48.673 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:48 +0000 (0:00:00.102) 0:01:41.835 ********* 2020-06-27T04:21:48.715 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-06-27T04:21:48.733 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:48.757 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:48 +0000 (0:00:00.077) 0:01:41.912 ********* 2020-06-27T04:21:49.748 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-06-27T04:21:49.750 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-06-27T04:21:49.790 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:49 +0000 (0:00:01.039) 0:01:42.951 ********* 2020-06-27T04:21:49.842 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-06-27T04:21:49.844 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532847616, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180871, 'block_used': 12914237, 'inode_total': 61054976, 'inode_available': 60990227, 'inode_used': 64749, 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180871, "block_size": 4096, "block_total": 240095108, "block_used": 12914237, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990227, "inode_total": 61054976, "inode_used": 64749, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532847616, "size_total": 983429562368, "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}} 2020-06-27T04:21:49.882 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:49 +0000 (0:00:00.092) 0:01:43.044 ********* 2020-06-27T04:21:50.108 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-06-27T04:21:50.110 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005291", "end": "2020-06-27 04:21:50.084322", "rc": 0, "start": "2020-06-27 04:21:50.079031", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:21:50.145 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:50 +0000 (0:00:00.263) 0:01:43.307 ********* 2020-06-27T04:21:50.211 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-06-27T04:21:50.212 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532847616, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180871, 'block_used': 12914237, 'inode_total': 61054976, 'inode_available': 60990227, 'inode_used': 64749, 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180871, "block_size": 4096, "block_total": 240095108, "block_used": 12914237, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990227, "inode_total": 61054976, "inode_used": 64749, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532847616, "size_total": 983429562368, "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:21:50.262 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:50 +0000 (0:00:00.116) 0:01:43.424 ********* 2020-06-27T04:21:50.294 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-06-27T04:21:50.334 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:50 +0000 (0:00:00.071) 0:01:43.495 ********* 2020-06-27T04:21:51.908 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-27T04:21:51.910 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKCYTdnLBzawjuI0oBnzRWq2WhDijfKVCe'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.311588", "end": "2020-06-27 04:21:51.872073", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKCYTdnLBzawjuI0oBnzRWq2WhDijfKVCe"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:21:50.560485", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:21:53.222 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Xfsonh-V9H0-uBey-jBxW-aArf-MhUQ-ZnLxdb', 'nvme-INTEL_SSDPEDMD400G4_CVFT533000D8400BGN', 'nvme-nvme.8086-43564654353333303030443834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.088370", "end": "2020-06-27 04:21:53.180167", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Xfsonh-V9H0-uBey-jBxW-aArf-MhUQ-ZnLxdb", "nvme-INTEL_SSDPEDMD400G4_CVFT533000D8400BGN", "nvme-nvme.8086-43564654353333303030443834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:21:52.091797", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-06-27T04:21:53.224 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:21:54.489 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKz9wsn51ioxfw0NDqrMn8Kni7E0MfXmAt'], 'uuids': ['b04163ec-2b51-439c-af89-98d737a1d388'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.057043", "end": "2020-06-27 04:21:54.458483", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKz9wsn51ioxfw0NDqrMn8Kni7E0MfXmAt"], "labels": [], "masters": [], "uuids": ["b04163ec-2b51-439c-af89-98d737a1d388"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:21:53.401440", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:21:55.768 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKLfeaN7a5SwvE0OCXPIcQlmhyBHDjqBoN'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.059035", "end": "2020-06-27 04:21:55.733388", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKLfeaN7a5SwvE0OCXPIcQlmhyBHDjqBoN"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:21:54.674353", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:21:57.047 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKPclsqzG8suUbE7ax0H5OM327S10JvsOz'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.049340", "end": "2020-06-27 04:21:57.007488", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKPclsqzG8suUbE7ax0H5OM327S10JvsOz"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:21:55.958148", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:21:57.061 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2SL', 'wwn-0x5000c500871b6e94'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4J2SL', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871b6e94', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2SL-part1', 'wwn-0x5000c500871b6e94-part1'], 'uuids': ['220eacd9-89e4-405a-9715-0beec0854dc9'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2SL", "wwn-0x5000c500871b6e94"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2SL-part1", "wwn-0x5000c500871b6e94-part1"], "labels": [], "masters": [], "uuids": ["220eacd9-89e4-405a-9715-0beec0854dc9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2SL", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b6e94"}}, 2020-06-27T04:21:57.064 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-06-27T04:21:58.337 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCK4QqL3JmxZtTN1S3mR9TyFGJphH4p3x11'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.065448", "end": "2020-06-27 04:21:58.299614", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCK4QqL3JmxZtTN1S3mR9TyFGJphH4p3x11"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:21:57.234166", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-27T04:21:58.377 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:21:58 +0000 (0:00:08.042) 0:01:51.538 ********* 2020-06-27T04:21:58.783 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-06-27T04:21:58.785 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKCYTdnLBzawjuI0oBnzRWq2WhDijfKVCe'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.135308", "end": "2020-06-27 04:21:58.749463", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKCYTdnLBzawjuI0oBnzRWq2WhDijfKVCe"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:21:58.614155", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.132541 s, 870 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.132541 s, 870 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:21:59.023 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Xfsonh-V9H0-uBey-jBxW-aArf-MhUQ-ZnLxdb', 'nvme-INTEL_SSDPEDMD400G4_CVFT533000D8400BGN', 'nvme-nvme.8086-43564654353333303030443834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036499", "end": "2020-06-27 04:21:58.993678", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Xfsonh-V9H0-uBey-jBxW-aArf-MhUQ-ZnLxdb", "nvme-INTEL_SSDPEDMD400G4_CVFT533000D8400BGN", "nvme-nvme.8086-43564654353333303030443834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:21:58.957179", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0336763 s, 3.4 GB/s", "std 2020-06-27T04:21:59.025 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0336763 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:21:59.376 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKz9wsn51ioxfw0NDqrMn8Kni7E0MfXmAt'], 'uuids': ['b04163ec-2b51-439c-af89-98d737a1d388'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.137498", "end": "2020-06-27 04:21:59.344784", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKz9wsn51ioxfw0NDqrMn8Kni7E0MfXmAt"], "labels": [], "masters": [], "uuids": ["b04163ec-2b51-439c-af89-98d737a1d388"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:21:59.207286", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.134751 s, 856 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.134751 s, 856 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:21:59.711 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKLfeaN7a5SwvE0OCXPIcQlmhyBHDjqBoN'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.135449", "end": "2020-06-27 04:21:59.684751", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKLfeaN7a5SwvE0OCXPIcQlmhyBHDjqBoN"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:21:59.549302", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.132778 s, 869 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.132778 s, 869 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:22:00.053 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKPclsqzG8suUbE7ax0H5OM327S10JvsOz'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.136598", "end": "2020-06-27 04:22:00.022650", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCKPclsqzG8suUbE7ax0H5OM327S10JvsOz"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:21:59.886052", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.133989 s, 861 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.133989 s, 861 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:22:00.064 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2SL', 'wwn-0x5000c500871b6e94'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4J2SL', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871b6e94', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2SL-part1', 'wwn-0x5000c500871b6e94-part1'], 'uuids': ['220eacd9-89e4-405a-9715-0beec0854dc9'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2SL", "wwn-0x5000c500871b6e94"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2SL-part1", "wwn-0x5000c500871b6e94-part1"], "labels": [], "masters": [], "uuids": ["220eacd9-89e4-405a-9715-0beec0854dc9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2SL", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b6e94"}}, 2020-06-27T04:22:00.066 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-06-27T04:22:00.400 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCK4QqL3JmxZtTN1S3mR9TyFGJphH4p3x11'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.135765", "end": "2020-06-27 04:22:00.370534", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-lfLgQVxf1Q8hXSgI2ZAvKFbokWQg1gCK4QqL3JmxZtTN1S3mR9TyFGJphH4p3x11"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-27 04:22:00.234769", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.133114 s, 867 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.133114 s, 867 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-27T04:22:00.449 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:00 +0000 (0:00:02.072) 0:01:53.611 ********* 2020-06-27T04:22:00.738 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-06-27T04:22:00.740 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.065059", "end": "2020-06-27 04:22:00.703979", "rc": 0, "start": "2020-06-27 04:22:00.638920", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:22:00.772 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:00 +0000 (0:00:00.323) 0:01:53.934 ********* 2020-06-27T04:22:01.024 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-06-27T04:22:01.026 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.043033", "end": "2020-06-27 04:22:01.002809", "rc": 0, "start": "2020-06-27 04:22:00.959776", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:22:01.059 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:01 +0000 (0:00:00.286) 0:01:54.220 ********* 2020-06-27T04:22:01.089 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-06-27T04:22:01.128 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:01 +0000 (0:00:00.069) 0:01:54.290 ********* 2020-06-27T04:22:01.169 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:01.207 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:01 +0000 (0:00:00.078) 0:01:54.368 ********* 2020-06-27T04:22:01.246 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-06-27T04:22:01.248 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:01.290 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:01 +0000 (0:00:00.077) 0:01:54.446 ********* 2020-06-27T04:22:01.318 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:01.353 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:01 +0000 (0:00:00.069) 0:01:54.515 ********* 2020-06-27T04:22:01.395 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-06-27T04:22:01.397 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:01.441 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:01 +0000 (0:00:00.087) 0:01:54.602 ********* 2020-06-27T04:22:01.669 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-06-27T04:22:01.671 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-27T04:22:01.705 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:01 +0000 (0:00:00.263) 0:01:54.866 ********* 2020-06-27T04:22:01.761 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi017.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532847616, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180871, 'block_used': 12914237, 'inode_total': 61054976, 'inode_available': 60990227, 'inode_used': 64749, 'uuid': '220eacd9-89e4-405a-9715-0beec0854dc9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180871, "block_size": 4096, "block_total": 240095108, "block_used": 12914237, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990227, "inode_total": 61054976, "inode_used": 64749, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532847616, "size_total": 983429562368, "uuid": "220eacd9-89e4-405a-9715-0beec0854dc9"}, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:01.805 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:01 +0000 (0:00:00.100) 0:01:54.966 ********* 2020-06-27T04:22:02.047 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Saturday 27 June 2020 04:22:01 +0000 (0:00:00.077) 0:01:55.044 ********* TASK [testnode : set_fact] ***************************************************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Saturday 27 June 2020 04:22:01 +0000 (0:00:00.077) 0:01:55.121 ********* TASK [testnode : set_fact] ***************************************************** skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:02.051 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:02 +0000 (0:00:00.092) 0:01:55.213 ********* 2020-06-27T04:22:02.084 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-06-27T04:22:02.086 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:02.122 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:02 +0000 (0:00:00.070) 0:01:55.283 ********* 2020-06-27T04:22:02.162 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-06-27T04:22:02.164 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:02.198 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:02 +0000 (0:00:00.076) 0:01:55.360 ********* 2020-06-27T04:22:02.243 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-06-27T04:22:02.245 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:02.281 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:02 +0000 (0:00:00.081) 0:01:55.442 ********* 2020-06-27T04:22:03.076 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-06-27T04:22:03.112 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:03 +0000 (0:00:00.830) 0:01:56.273 ********* 2020-06-27T04:22:03.826 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-06-27T04:22:03.828 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:22:04.172 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:22:04.522 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:22:04.927 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:22:05.291 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-27T04:22:05.326 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:05 +0000 (0:00:02.214) 0:01:58.488 ********* 2020-06-27T04:22:05.547 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-06-27T04:22:05.549 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-06-27T04:22:05.583 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:05 +0000 (0:00:00.256) 0:01:58.744 ********* 2020-06-27T04:22:05.821 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-06-27T04:22:05.823 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-27T04:22:06.013 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-27T04:22:06.213 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-27T04:22:06.422 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-27T04:22:06.446 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:06.481 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:06 +0000 (0:00:00.897) 0:01:59.642 ********* 2020-06-27T04:22:06.715 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-27T04:22:06.756 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:06 +0000 (0:00:00.275) 0:01:59.918 ********* 2020-06-27T04:22:06.798 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-06-27T04:22:06.799 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-06-27T04:22:06.835 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:06 +0000 (0:00:00.078) 0:01:59.996 ********* 2020-06-27T04:22:07.454 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi017.front.sepia.ceph.com] => {"changed": true} 2020-06-27T04:22:07.497 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:07 +0000 (0:00:00.662) 0:02:00.659 ********* 2020-06-27T04:22:09.146 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-06-27T04:22:09.147 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-06-27T04:22:09.180 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:09 +0000 (0:00:01.682) 0:02:02.341 ********* 2020-06-27T04:22:09.212 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-06-27T04:22:09.214 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:09.247 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:09 +0000 (0:00:00.067) 0:02:02.409 ********* 2020-06-27T04:22:09.277 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-06-27T04:22:09.278 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:09.312 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:09 +0000 (0:00:00.064) 0:02:02.473 ********* 2020-06-27T04:22:09.342 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-06-27T04:22:09.343 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:09.378 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:09 +0000 (0:00:00.066) 0:02:02.540 ********* 2020-06-27T04:22:09.422 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-06-27T04:22:09.424 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:09.458 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:09 +0000 (0:00:00.079) 0:02:02.619 ********* 2020-06-27T04:22:09.489 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-06-27T04:22:09.491 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:09.524 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:09 +0000 (0:00:00.066) 0:02:02.686 ********* 2020-06-27T04:22:09.555 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-06-27T04:22:09.557 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:09.591 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:09 +0000 (0:00:00.067) 0:02:02.753 ********* 2020-06-27T04:22:09.625 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-06-27T04:22:09.627 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:09.663 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:09 +0000 (0:00:00.071) 0:02:02.825 ********* 2020-06-27T04:22:09.695 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-06-27T04:22:09.699 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:09.732 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:09 +0000 (0:00:00.068) 0:02:02.894 ********* 2020-06-27T04:22:09.763 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-06-27T04:22:09.765 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:09.798 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:09 +0000 (0:00:00.065) 0:02:02.960 ********* 2020-06-27T04:22:09.839 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-06-27T04:22:09.841 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:09.875 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:09 +0000 (0:00:00.076) 0:02:03.036 ********* 2020-06-27T04:22:09.905 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-06-27T04:22:09.907 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:09.941 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:09 +0000 (0:00:00.066) 0:02:03.102 ********* 2020-06-27T04:22:10.497 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-06-27T04:22:10.498 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-06-27T04:22:10.533 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:10 +0000 (0:00:00.592) 0:02:03.695 ********* 2020-06-27T04:22:10.864 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-06-27T04:22:10.865 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-06-27 04:19:16 UTC", "ActiveEnterTimestampMonotonic": "19971870", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket systemd-tmpfiles-setup.service ntpdate.service tmp.mount basic.target ntpd.service system.slice -.mount sntp.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-06-27 04:19:14 UTC", "AssertTimestampMonotonic": "18541124", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-06-27 04:19:14 UTC", "ConditionTimestampMonotonic": "18541096", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-06-27T04:22:10.867 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2453", "ExecMainStartTimestamp": "Sat 2020-06-27 04:19:16 UTC", "ExecMainStartTimestampMonotonic": "19884142", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Sat 2020-06-27 04:19:14 UTC] ; stop_time=[Sat 2020-06-27 04:19:16 UTC] ; pid=2426 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Sat 2020-06-27 04:19:16 UTC] ; stop_time=[Sat 2020-06-27 04:19:16 UTC] ; pid=2497 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-06-27 04:19:14 UTC", "InactiveExitTimestampMonotonic": "18566479", "InvocationID": "b3b2dd1344fe4860a2a4484f7f7754e1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZE 2020-06-27T04:22:10.868 INFO:teuthology.task.ansible.out:Soft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2453", "MemoryAccounting": "yes", "MemoryCurrent": "2641920", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no" 2020-06-27T04:22:10.870 INFO:teuthology.task.ansible.out:, "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-06-27 04:19:16 UTC", "StateChangeTimestampMonotonic": "19971870", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-06-27 04:19:16 UTC", "WatchdogTimestampMonotonic": "19884152", "WatchdogUSec": "0"}} 2020-06-27T04:22:10.901 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:10 +0000 (0:00:00.367) 0:02:04.062 ********* 2020-06-27T04:22:10.929 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:22:10.931 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-06-27T04:22:10.964 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:10 +0000 (0:00:00.063) 0:02:04.126 ********* 2020-06-27T04:22:11.017 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:22:11.019 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-06-27T04:22:11.055 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:11 +0000 (0:00:00.090) 0:02:04.216 ********* 2020-06-27T04:22:11.085 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-06-27T04:22:11.087 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:11.119 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:11 +0000 (0:00:00.064) 0:02:04.281 ********* 2020-06-27T04:22:11.149 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-06-27T04:22:11.151 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:11.183 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:11 +0000 (0:00:00.064) 0:02:04.345 ********* 2020-06-27T04:22:11.226 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-06-27T04:22:11.228 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:11.261 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:11 +0000 (0:00:00.077) 0:02:04.422 ********* 2020-06-27T04:22:11.487 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "gid": 1220, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-06-27T04:22:11.522 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:11 +0000 (0:00:00.261) 0:02:04.684 ********* 2020-06-27T04:22:12.073 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-06-27T04:22:12.075 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1220, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-06-27T04:22:12.121 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:12 +0000 (0:00:00.598) 0:02:05.283 ********* 2020-06-27T04:22:13.537 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-06-27T04:22:13.576 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:13 +0000 (0:00:01.454) 0:02:06.737 ********* 2020-06-27T04:22:13.606 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:13.641 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:13 +0000 (0:00:00.065) 0:02:06.802 ********* 2020-06-27T04:22:13.672 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-06-27T04:22:13.674 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-06-27T04:22:13.711 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:13 +0000 (0:00:00.070) 0:02:06.872 ********* 2020-06-27T04:22:13.926 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-06-27T04:22:13.928 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-06-27T04:22:13.966 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:13 +0000 (0:00:00.254) 0:02:07.127 ********* 2020-06-27T04:22:13.997 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-06-27T04:22:13.999 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:14.032 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:14 +0000 (0:00:00.065) 0:02:07.193 ********* 2020-06-27T04:22:14.066 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-06-27T04:22:14.067 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-06-27T04:22:14.104 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:14 +0000 (0:00:00.072) 0:02:07.265 ********* 2020-06-27T04:22:14.140 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-06-27T04:22:14.142 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:14.178 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:14 +0000 (0:00:00.074) 0:02:07.340 ********* 2020-06-27T04:22:14.394 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-06-27T04:22:14.395 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-06-27T04:22:14.440 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:14 +0000 (0:00:00.262) 0:02:07.602 ********* 2020-06-27T04:22:14.662 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-06-27T04:22:14.664 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-06-27T04:22:14.703 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:14 +0000 (0:00:00.262) 0:02:07.865 ********* 2020-06-27T04:22:14.736 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-06-27T04:22:14.738 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:14.772 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:14 +0000 (0:00:00.068) 0:02:07.934 ********* 2020-06-27T04:22:14.813 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-06-27T04:22:14.815 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-06-27T04:22:14.825 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-06-27T04:22:14.826 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-06-27T04:22:14.837 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-06-27T04:22:14.873 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:14 +0000 (0:00:00.100) 0:02:08.034 ********* 2020-06-27T04:22:14.909 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-06-27T04:22:14.911 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:14.920 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:14.947 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi017.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:14.948 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:14.986 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:14 +0000 (0:00:00.112) 0:02:08.147 ********* 2020-06-27T04:22:15.037 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-27T04:22:15.039 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:15.080 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:15 +0000 (0:00:00.094) 0:02:08.241 ********* 2020-06-27T04:22:15.127 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-06-27T04:22:15.129 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:15.163 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:15 +0000 (0:00:00.083) 0:02:08.324 ********* 2020-06-27T04:22:15.194 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-06-27T04:22:15.196 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:15.235 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:15 +0000 (0:00:00.069) 0:02:08.394 ********* 2020-06-27T04:22:15.271 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-06-27T04:22:15.273 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:15.306 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:15 +0000 (0:00:00.073) 0:02:08.468 ********* 2020-06-27T04:22:15.338 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-06-27T04:22:15.339 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:15.375 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:15 +0000 (0:00:00.068) 0:02:08.537 ********* 2020-06-27T04:22:15.409 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-06-27T04:22:15.411 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:15.448 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:15 +0000 (0:00:00.072) 0:02:08.609 ********* 2020-06-27T04:22:15.478 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-06-27T04:22:15.480 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:15.522 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:15 +0000 (0:00:00.073) 0:02:08.683 ********* 2020-06-27T04:22:15.577 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-06-27T04:22:15.579 INFO:teuthology.task.ansible.out:skipping: [smithi017.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-27T04:22:15.613 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:15 +0000 (0:00:00.092) 0:02:08.775 ********* 2020-06-27T04:22:16.866 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-06-27T04:22:16.868 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.006557", "end": "2020-06-27 04:22:16.826998", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-06-27 04:22:15.820441", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:22:18.082 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:01.004294", "end": "2020-06-27 04:22:18.042833", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-06-27 04:22:17.038539", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:22:18.301 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002984", "end": "2020-06-27 04:22:18.272639", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-06-27 04:22:18.269655", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-06-27T04:22:19.537 INFO:teuthology.task.ansible.out:ok: [smithi017.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:01.029524", "end": "2020-06-27 04:22:19.497883", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-06-27 04:22:18.468359", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-27T04:22:19.573 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:19 +0000 (0:00:03.959) 0:02:12.734 ********* 2020-06-27T04:22:19.602 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-06-27T04:22:19.643 INFO:teuthology.task.ansible.out:Saturday 27 June 2020 04:22:19 +0000 (0:00:00.067) 0:02:12.802 ********* 2020-06-27T04:22:19.872 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-06-27T04:22:19.874 INFO:teuthology.task.ansible.out:changed: [smithi017.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-06-27T04:22:19.970 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-06-27T04:22:19.974 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-06-27T04:22:19.977 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2020-06-27T04:22:19.979 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi017.front.sepia.ceph.com : ok=112 changed=31 unreachable=0 failed=0 skipped=177 rescued=0 ignored=3 Saturday 27 June 2020 04:22:19 +0000 (0:00:00.336) 0:02:13.139 ********* =============================================================================== common : nrpe - Remove SELinux policy package -------------------------- 17.14s common : nrpe - Load SELinux policy package ---------------------------- 17.03s testnode : Zap all non-root disks --------------------------------------- 8.04s testnode : List any leftover Ceph artifacts from previous jobs ---------- 3.96s testnode : Install packages --------------------------------------------- 3.20s Gathering Facts --------------------------------------------------------- 2.65s testnode : Ensure ceph packages are not present. ------------------------ 2.58s testnode : Create logical volume(s) ------------------------------------- 2.21s testnode : Rebuild rpmdb ------------------------------------------------ 2.12s testnode : Ensure ceph dependency packages are not present. ------------- 2.09s testnode : Blow away lingering OSD data and FSIDs ----------------------- 2.07s Gathering Facts --------------------------------------------------------- 1.78s testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph --------------------- 1.68s testnode : Configure local mirrorlists ---------------------------------- 1.64s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.63s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.59s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.55s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.49s testnode : Install packages via pip ------------------------------------- 1.45s common : Install Kerberos Pac 2020-06-27T04:22:19.981 INFO:teuthology.task.ansible.out:kages (RedHat) ----------------------------- 1.38s 2020-06-27T04:22:20.360 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com')] 2020-06-27T04:22:20.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-27T04:22:20.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-27T04:22:20.454 INFO:teuthology.orchestra.run.smithi017:> true 2020-06-27T04:22:20.541 INFO:teuthology.run_tasks:Running task clock... 2020-06-27T04:22:20.556 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-06-27T04:22:20.557 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-06-27T04:22:20.557 INFO:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-06-27T04:22:20.623 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-06-27T04:22:20.646 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-06-27T04:22:20.696 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2020-06-27T04:22:20.713 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2020-06-27T04:22:20.734 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-06-27T04:22:20.755 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-06-27T04:22:20.818 INFO:teuthology.orchestra.run.smithi017.stderr:bash: ntpq: command not found 2020-06-27T04:22:20.820 INFO:teuthology.orchestra.run.smithi017.stdout:210 Number of sources = 4 2020-06-27T04:22:20.821 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-06-27T04:22:20.821 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2020-06-27T04:22:20.821 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-27T04:22:20.821 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-27T04:22:20.822 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-27T04:22:20.822 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-27T04:22:20.822 INFO:teuthology.run_tasks:Running task install... 2020-06-27T04:22:20.844 DEBUG:teuthology.task.install:project ceph 2020-06-27T04:22:20.845 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5'}} 2020-06-27T04:22:20.845 DEBUG:teuthology.task.install:config {'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5'} 2020-06-27T04:22:20.846 INFO:teuthology.task.install:Using flavor: basic 2020-06-27T04:22:20.856 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-06-27T04:22:20.856 INFO:teuthology.task.install:extra packages: [] 2020-06-27T04:22:20.857 INFO:teuthology.orchestra.run.smithi017:> sudo lsb_release -is 2020-06-27T04:22:20.900 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS 2020-06-27T04:22:20.902 DEBUG:teuthology.misc:System to be installed: CentOS 2020-06-27T04:22:20.903 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'tag': None, 'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'debuginfo': None, 'flavor': 'basic', 'downgrade_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'exclude_packages': [], 'extras': None, 'wait_for_package': False, 'project': 'ceph', 'packages': {}, 'install_ceph_packages': True, 'repos_only': False} 2020-06-27T04:22:20.904 INFO:teuthology.orchestra.run.smithi017:> sudo lsb_release -is 2020-06-27T04:22:20.982 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS 2020-06-27T04:22:20.984 DEBUG:teuthology.misc:System to be installed: CentOS 2020-06-27T04:22:20.985 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 2020-06-27T04:22:21.200 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-06-26-1211/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/centos/8/flavors/default/ 2020-06-27T04:22:21.201 INFO:teuthology.task.install.rpm:Package version is 16.0.0-2978.g77ddaecfcb0 2020-06-27T04:22:21.411 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-06-26-1211/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-06-26-1211/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-kefu-testing-2020-06-26-1211/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-06-27T04:22:21.412 INFO:teuthology.orchestra.run.smithi017:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-06-27T04:22:21.460 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-06-27T04:22:21.460 INFO:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-06-27T04:22:21.549 INFO:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-06-27T04:22:21.639 INFO:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-06-27T04:22:21.669 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2020-06-27T04:22:21.670 INFO:teuthology.orchestra.run.smithi017:> sudo yum clean all 2020-06-27T04:22:21.970 INFO:teuthology.orchestra.run.smithi017.stdout:46 files removed 2020-06-27T04:22:21.997 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw 2020-06-27T04:22:22.626 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 276 kB/s | 71 kB 00:00 2020-06-27T04:22:22.874 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 67 kB/s | 14 kB 00:00 2020-06-27T04:22:23.113 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 6.6 kB/s | 1.4 kB 00:00 2020-06-27T04:22:23.289 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-8 - AppStream 45 MB/s | 7.0 MB 00:00 2020-06-27T04:22:24.562 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-06-27T04:22:24.998 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-06-27T04:22:25.151 INFO:teuthology.orchestra.run.smithi017.stdout:Copr repo for ceph-el8 owned by ktdreyer 2.5 kB/s | 257 B 00:00 2020-06-27T04:22:25.801 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 12 MB/s | 7.1 MB 00:00 2020-06-27T04:22:27.428 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 4.0 MB/s | 20 kB 00:00 2020-06-27T04:22:28.548 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:22:28.565 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:22:28.565 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2020-06-27T04:22:28.565 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:22:28.566 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:22:28.566 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 11 M 2020-06-27T04:22:28.566 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2020-06-27T04:22:28.566 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 3.7 M 2020-06-27T04:22:28.566 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 2.0 M 2020-06-27T04:22:28.567 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2020-06-27T04:22:28.567 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 6.0 M 2020-06-27T04:22:28.567 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 22 M 2020-06-27T04:22:28.567 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 25 k 2020-06-27T04:22:28.567 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 541 k 2020-06-27T04:22:28.568 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 489 k 2020-06-27T04:22:28.568 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 3.4 M 2020-06-27T04:22:28.568 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse 2020-06-27T04:22:28.568 INFO:teuthology.orchestra.run.smithi017.stdout: x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 40 k 2020-06-27T04:22:28.568 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common 2020-06-27T04:22:28.568 INFO:teuthology.orchestra.run.smithi017.stdout: x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 67 k 2020-06-27T04:22:28.569 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 204 k 2020-06-27T04:22:28.569 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 367 k 2020-06-27T04:22:28.569 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 332 k 2020-06-27T04:22:28.569 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 113 k 2020-06-27T04:22:28.569 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2020-06-27T04:22:28.570 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2020-06-27T04:22:28.570 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable 2020-06-27T04:22:28.570 INFO:teuthology.orchestra.run.smithi017.stdout: noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2020-06-27T04:22:28.570 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.9.0-1.el8 CentOS-Base 47 k 2020-06-27T04:22:28.570 INFO:teuthology.orchestra.run.smithi017.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-06-27T04:22:28.571 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-06-27T04:22:28.571 INFO:teuthology.orchestra.run.smithi017.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-06-27T04:22:28.571 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-06-27T04:22:28.571 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-06-27T04:22:28.571 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:22:28.572 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:22:28.572 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:22:28.572 INFO:teuthology.orchestra.run.smithi017.stdout:Install 22 Packages 2020-06-27T04:22:28.572 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 2 Packages 2020-06-27T04:22:28.572 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:22:28.573 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 51 M 2020-06-27T04:22:28.573 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:22:30.319 INFO:teuthology.orchestra.run.smithi017.stdout:(1/24): ceph-base-16.0.0-2978.g77ddaecfcb0.el8. 3.4 MB/s | 6.0 MB 00:01 2020-06-27T04:22:30.359 INFO:teuthology.orchestra.run.smithi017.stdout:(2/24): ceph-selinux-16.0.0-2978.g77ddaecfcb0.e 631 kB/s | 25 kB 00:00 2020-06-27T04:22:30.435 INFO:teuthology.orchestra.run.smithi017.stdout:(3/24): libcephfs2-16.0.0-2978.g77ddaecfcb0.el8 6.9 MB/s | 541 kB 00:00 2020-06-27T04:22:30.518 INFO:teuthology.orchestra.run.smithi017.stdout:(4/24): libradosstriper1-16.0.0-2978.g77ddaecfc 5.8 MB/s | 489 kB 00:00 2020-06-27T04:22:30.778 INFO:teuthology.orchestra.run.smithi017.stdout:(5/24): ceph-radosgw-16.0.0-2978.g77ddaecfcb0.e 4.8 MB/s | 11 MB 00:02 2020-06-27T04:22:30.822 INFO:teuthology.orchestra.run.smithi017.stdout:(6/24): python3-ceph-argparse-16.0.0-2978.g77dd 930 kB/s | 40 kB 00:00 2020-06-27T04:22:30.872 INFO:teuthology.orchestra.run.smithi017.stdout:(7/24): python3-ceph-common-16.0.0-2978.g77ddae 1.4 MB/s | 67 kB 00:00 2020-06-27T04:22:30.907 INFO:teuthology.orchestra.run.smithi017.stdout:(8/24): librgw2-16.0.0-2978.g77ddaecfcb0.el8.x8 8.7 MB/s | 3.4 MB 00:00 2020-06-27T04:22:30.908 INFO:teuthology.orchestra.run.smithi017.stdout:(9/24): python3-cephfs-16.0.0-2978.g77ddaecfcb0 4.9 MB/s | 204 kB 00:00 2020-06-27T04:22:30.939 INFO:teuthology.orchestra.run.smithi017.stdout:(10/24): python3-rados-16.0.0-2978.g77ddaecfcb0 11 MB/s | 367 kB 00:00 2020-06-27T04:22:30.959 INFO:teuthology.orchestra.run.smithi017.stdout:(11/24): python3-rbd-16.0.0-2978.g77ddaecfcb0.e 7.2 MB/s | 332 kB 00:00 2020-06-27T04:22:30.974 INFO:teuthology.orchestra.run.smithi017.stdout:(12/24): python3-rgw-16.0.0-2978.g77ddaecfcb0.e 3.2 MB/s | 113 kB 00:00 2020-06-27T04:22:31.000 INFO:teuthology.orchestra.run.smithi017.stdout:(13/24): librdkafka-0.11.4-1.el8.x86_64.rpm 7.4 MB/s | 353 kB 00:00 2020-06-27T04:22:31.002 INFO:teuthology.orchestra.run.smithi017.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 29 MB/s | 44 kB 00:00 2020-06-27T04:22:31.003 INFO:teuthology.orchestra.run.smithi017.stdout:(15/24): librabbitmq-0.9.0-1.el8.x86_64.rpm 33 MB/s | 47 kB 00:00 2020-06-27T04:22:31.008 INFO:teuthology.orchestra.run.smithi017.stdout:(16/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.3 MB/s | 259 kB 00:00 2020-06-27T04:22:31.081 INFO:teuthology.orchestra.run.smithi017.stdout:(17/24): fmt-6.2.1-1.el8.x86_64.rpm 1.5 MB/s | 116 kB 00:00 2020-06-27T04:22:31.114 INFO:teuthology.orchestra.run.smithi017.stdout:(18/24): leveldb-1.22-1.el8.x86_64.rpm 5.6 MB/s | 181 kB 00:00 2020-06-27T04:22:31.121 INFO:teuthology.orchestra.run.smithi017.stdout:(19/24): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-06-27T04:22:31.129 INFO:teuthology.orchestra.run.smithi017.stdout:(20/24): liboath-2.6.2-3.el8.x86_64.rpm 3.6 MB/s | 59 kB 00:00 2020-06-27T04:22:31.140 INFO:teuthology.orchestra.run.smithi017.stdout:(21/24): libunwind-1.3.1-3.el8.x86_64.rpm 3.8 MB/s | 75 kB 00:00 2020-06-27T04:22:31.389 INFO:teuthology.orchestra.run.smithi017.stdout:(22/24): librbd1-16.0.0-2978.g77ddaecfcb0.el8.x 8.1 MB/s | 2.0 MB 00:00 2020-06-27T04:22:31.485 INFO:teuthology.orchestra.run.smithi017.stdout:(23/24): librados2-16.0.0-2978.g77ddaecfcb0.el8 10 MB/s | 3.7 MB 00:00 2020-06-27T04:22:31.714 INFO:teuthology.orchestra.run.smithi017.stdout:(24/24): ceph-common-16.0.0-2978.g77ddaecfcb0.e 7.0 MB/s | 22 MB 00:03 2020-06-27T04:22:31.717 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:22:31.717 INFO:teuthology.orchestra.run.smithi017.stdout:Total 16 MB/s | 51 MB 00:03 2020-06-27T04:22:31.724 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:22:31.838 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:22:31.838 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:22:32.379 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:22:32.379 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:22:33.566 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:22:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2020-06-27T04:22:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2020-06-27T04:22:34.103 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2020-06-27T04:22:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2020-06-27T04:22:34.720 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 4/26 2020-06-27T04:22:34.851 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 4/26 2020-06-27T04:22:35.076 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 5/26 2020-06-27T04:22:35.220 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 6/26 2020-06-27T04:22:35.473 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 6/26 2020-06-27T04:22:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 7/26 2020-06-27T04:22:35.739 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 7/26 2020-06-27T04:22:35.955 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 8/26 2020-06-27T04:22:36.119 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/26 2020-06-27T04:22:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/26 2020-06-27T04:22:36.628 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 10/26 2020-06-27T04:22:36.738 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 10/26 2020-06-27T04:22:36.916 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2020-06-27T04:22:37.026 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:16.0.0-2978.g77ddaecfcb0.e 12/26 2020-06-27T04:22:37.212 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:16.0.0-2978.g77ddaecfcb0.el8.x86_ 13/26 2020-06-27T04:22:37.520 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 14/26 2020-06-27T04:22:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 15/26 2020-06-27T04:22:37.871 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:16.0.0-2978.g77ddaecfcb0.el8.x8 16/26 2020-06-27T04:22:37.947 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:16.0.0-2978.g77ddaecfcb0.el8.x8 16/26 2020-06-27T04:22:38.134 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2020-06-27T04:22:38.303 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 18/26 2020-06-27T04:22:38.484 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2020-06-27T04:22:38.654 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8 20/26 2020-06-27T04:22:42.803 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 21/26 2020-06-27T04:22:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 21/26 2020-06-27T04:22:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 21/26 2020-06-27T04:22:44.039 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 22/26 2020-06-27T04:22:44.124 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 22/26 2020-06-27T04:22:44.227 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 23/26 2020-06-27T04:23:01.630 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 23/26 2020-06-27T04:23:01.630 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2020-06-27T04:23:01.630 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2020-06-27T04:23:01.631 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /dev 2020-06-27T04:23:01.631 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /run 2020-06-27T04:23:01.631 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2020-06-27T04:23:01.631 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2020-06-27T04:23:01.631 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2020-06-27T04:23:01.632 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2020-06-27T04:23:01.632 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /dev 2020-06-27T04:23:01.632 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 24/26 2020-06-27T04:23:02.892 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 24/26 2020-06-27T04:23:02.893 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2020-06-27T04:23:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2020-06-27T04:23:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2020-06-27T04:23:03.728 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2020-06-27T04:23:03.728 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/26 2020-06-27T04:23:03.729 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2/26 2020-06-27T04:23:03.729 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 3/26 2020-06-27T04:23:03.729 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 4/26 2020-06-27T04:23:03.729 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 5/26 2020-06-27T04:23:03.730 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:16.0.0-2978.g77ddaecfcb0.el8.x8 6/26 2020-06-27T04:23:03.730 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 7/26 2020-06-27T04:23:03.730 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:16.0.0-2978.g77ddaecfcb0.e 8/26 2020-06-27T04:23:03.730 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8 9/26 2020-06-27T04:23:03.730 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:16.0.0-2978.g77ddaecfcb0.el8.x86_ 10/26 2020-06-27T04:23:03.731 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 11/26 2020-06-27T04:23:03.731 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 12/26 2020-06-27T04:23:03.731 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 13/26 2020-06-27T04:23:03.731 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/26 2020-06-27T04:23:03.732 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2020-06-27T04:23:03.732 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2020-06-27T04:23:03.732 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 17/26 2020-06-27T04:23:03.732 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2020-06-27T04:23:03.732 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 19/26 2020-06-27T04:23:03.732 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2020-06-27T04:23:03.733 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2020-06-27T04:23:03.733 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2020-06-27T04:23:03.733 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 23/26 2020-06-27T04:23:03.733 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2020-06-27T04:23:03.733 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 25/26 2020-06-27T04:23:04.425 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2020-06-27T04:23:04.435 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:04.435 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2020-06-27T04:23:04.435 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:04.436 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:23:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-06-27T04:23:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-06-27T04:23:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-06-27T04:23:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-06-27T04:23:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: fmt-6.2.1-1.el8.x86_64 2020-06-27T04:23:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-06-27T04:23:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: leveldb-1.22-1.el8.x86_64 2020-06-27T04:23:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.2-3.el8.x86_64 2020-06-27T04:23:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.3.1-3.el8.x86_64 2020-06-27T04:23:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:04.441 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:23:04.930 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-test 2020-06-27T04:23:05.380 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:38 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:23:05.821 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:23:05.822 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:05.823 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2020-06-27T04:23:05.823 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:05.823 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:23:05.824 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 45 M 2020-06-27T04:23:05.824 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2020-06-27T04:23:05.824 INFO:teuthology.orchestra.run.smithi017.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2020-06-27T04:23:05.824 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma x86_64 6.8.2-1.el8 CentOS-AppStream 188 k 2020-06-27T04:23:05.825 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.3.2-6.el8 CentOS-AppStream 298 k 2020-06-27T04:23:05.825 INFO:teuthology.orchestra.run.smithi017.stdout: libxslt x86_64 1.1.32-3.el8 CentOS-Base 249 k 2020-06-27T04:23:05.825 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-06-27T04:23:05.825 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:05.826 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:23:05.826 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:05.826 INFO:teuthology.orchestra.run.smithi017.stdout:Install 6 Packages 2020-06-27T04:23:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:05.827 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 46 M 2020-06-27T04:23:05.827 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 196 M 2020-06-27T04:23:05.828 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:23:05.863 INFO:teuthology.orchestra.run.smithi017.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.2 MB/s | 161 kB 00:00 2020-06-27T04:23:05.865 INFO:teuthology.orchestra.run.smithi017.stdout:(2/6): oniguruma-6.8.2-1.el8.x86_64.rpm 4.6 MB/s | 188 kB 00:00 2020-06-27T04:23:05.871 INFO:teuthology.orchestra.run.smithi017.stdout:(3/6): socat-1.7.3.2-6.el8.x86_64.rpm 34 MB/s | 298 kB 00:00 2020-06-27T04:23:05.875 INFO:teuthology.orchestra.run.smithi017.stdout:(4/6): libxslt-1.1.32-3.el8.x86_64.rpm 26 MB/s | 249 kB 00:00 2020-06-27T04:23:05.934 INFO:teuthology.orchestra.run.smithi017.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2020-06-27T04:23:07.924 INFO:teuthology.orchestra.run.smithi017.stdout:(6/6): ceph-test-16.0.0-2978.g77ddaecfcb0.el8.x 21 MB/s | 45 MB 00:02 2020-06-27T04:23:07.927 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:23:07.927 INFO:teuthology.orchestra.run.smithi017.stdout:Total 22 MB/s | 46 MB 00:02 2020-06-27T04:23:07.934 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:23:07.958 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:23:07.958 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:23:08.234 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:23:08.235 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:23:08.733 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:23:08.909 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 1/6 2020-06-27T04:23:09.108 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-06-27T04:23:09.266 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 3/6 2020-06-27T04:23:09.423 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 4/6 2020-06-27T04:23:09.508 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 4/6 2020-06-27T04:23:14.056 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2020-06-27T04:23:14.288 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 6/6 2020-06-27T04:23:14.496 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-test-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 6/6 2020-06-27T04:23:14.497 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/6 2020-06-27T04:23:14.497 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2020-06-27T04:23:14.497 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/6 2020-06-27T04:23:14.498 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/6 2020-06-27T04:23:14.498 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 5/6 2020-06-27T04:23:14.899 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2020-06-27T04:23:14.899 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:14.900 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:23:14.900 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:14.900 INFO:teuthology.orchestra.run.smithi017.stdout: jq-1.5-12.el8.x86_64 2020-06-27T04:23:14.900 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-06-27T04:23:14.900 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.3.2-6.el8.x86_64 2020-06-27T04:23:14.901 INFO:teuthology.orchestra.run.smithi017.stdout: libxslt-1.1.32-3.el8.x86_64 2020-06-27T04:23:14.901 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-06-27T04:23:14.901 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:14.901 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:23:15.215 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph 2020-06-27T04:23:15.648 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:48 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:23:16.342 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:23:16.346 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:16.346 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2020-06-27T04:23:16.346 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:16.347 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:23:16.347 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:23:16.347 INFO:teuthology.orchestra.run.smithi017.stdout: ceph 6.5 k 2020-06-27T04:23:16.347 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2020-06-27T04:23:16.347 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:23:16.348 INFO:teuthology.orchestra.run.smithi017.stdout: ceph 2.1 M 2020-06-27T04:23:16.348 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:23:16.348 INFO:teuthology.orchestra.run.smithi017.stdout: ceph 1.5 M 2020-06-27T04:23:16.348 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:23:16.348 INFO:teuthology.orchestra.run.smithi017.stdout: ceph 4.9 M 2020-06-27T04:23:16.349 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:23:16.349 INFO:teuthology.orchestra.run.smithi017.stdout: ceph 18 M 2020-06-27T04:23:16.349 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:23:16.349 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-noarch 172 k 2020-06-27T04:23:16.350 INFO:teuthology.orchestra.run.smithi017.stdout: python3-lxml x86_64 4.2.3-1.el8 CentOS-AppStream 1.5 M 2020-06-27T04:23:16.350 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2020-06-27T04:23:16.350 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2020-06-27T04:23:16.350 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2020-06-27T04:23:16.351 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2020-06-27T04:23:16.351 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2020-06-27T04:23:16.351 INFO:teuthology.orchestra.run.smithi017.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2020-06-27T04:23:16.351 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2020-06-27T04:23:16.351 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-06-27T04:23:16.352 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.24.2-2.el8 CentOS-Base 176 k 2020-06-27T04:23:16.352 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-06-27T04:23:16.352 INFO:teuthology.orchestra.run.smithi017.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-06-27T04:23:16.352 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-06-27T04:23:16.352 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-06-27T04:23:16.353 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-06-27T04:23:16.353 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-06-27T04:23:16.353 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-06-27T04:23:16.355 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-06-27T04:23:16.356 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-06-27T04:23:16.356 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-06-27T04:23:16.356 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-06-27T04:23:16.356 INFO:teuthology.orchestra.run.smithi017.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-06-27T04:23:16.356 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-06-27T04:23:16.357 INFO:teuthology.orchestra.run.smithi017.stdout: python3-trustme noarch 0.5.2-4.el8 epel 26 k 2020-06-27T04:23:16.357 INFO:teuthology.orchestra.run.smithi017.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-06-27T04:23:16.357 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-06-27T04:23:16.357 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-06-27T04:23:16.357 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-06-27T04:23:16.358 INFO:teuthology.orchestra.run.smithi017.stdout:Installing weak dependencies: 2020-06-27T04:23:16.358 INFO:teuthology.orchestra.run.smithi017.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-06-27T04:23:16.358 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-06-27T04:23:16.358 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:16.358 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:23:16.370 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:16.370 INFO:teuthology.orchestra.run.smithi017.stdout:Install 36 Packages 2020-06-27T04:23:16.370 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:16.371 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 32 M 2020-06-27T04:23:16.371 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 111 M 2020-06-27T04:23:16.372 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:23:16.556 INFO:teuthology.orchestra.run.smithi017.stdout:(1/36): ceph-16.0.0-2978.g77ddaecfcb0.el8.x86_6 32 kB/s | 6.5 kB 00:00 2020-06-27T04:23:17.139 INFO:teuthology.orchestra.run.smithi017.stdout:(2/36): ceph-mgr-16.0.0-2978.g77ddaecfcb0.el8.x 1.9 MB/s | 1.5 MB 00:00 2020-06-27T04:23:17.202 INFO:teuthology.orchestra.run.smithi017.stdout:(3/36): ceph-mds-16.0.0-2978.g77ddaecfcb0.el8.x 2.5 MB/s | 2.1 MB 00:00 2020-06-27T04:23:17.275 INFO:teuthology.orchestra.run.smithi017.stdout:(4/36): ceph-mgr-modules-core-16.0.0-2978.g77dd 2.3 MB/s | 172 kB 00:00 2020-06-27T04:23:17.367 INFO:teuthology.orchestra.run.smithi017.stdout:(5/36): python3-html5lib-0.999999999-6.el8.noar 2.3 MB/s | 214 kB 00:00 2020-06-27T04:23:17.441 INFO:teuthology.orchestra.run.smithi017.stdout:(6/36): python3-lxml-4.2.3-1.el8.x86_64.rpm 20 MB/s | 1.5 MB 00:00 2020-06-27T04:23:17.492 INFO:teuthology.orchestra.run.smithi017.stdout:(7/36): python3-mako-1.0.6-13.el8.noarch.rpm 3.0 MB/s | 157 kB 00:00 2020-06-27T04:23:17.596 INFO:teuthology.orchestra.run.smithi017.stdout:(8/36): python3-markupsafe-0.23-19.el8.x86_64.r 374 kB/s | 39 kB 00:00 2020-06-27T04:23:17.606 INFO:teuthology.orchestra.run.smithi017.stdout:(9/36): python3-pytz-2017.2-9.el8.noarch.rpm 31 MB/s | 54 kB 00:00 2020-06-27T04:23:17.606 INFO:teuthology.orchestra.run.smithi017.stdout:(10/36): python3-webencodings-0.5.1-6.el8.noarc 5.4 MB/s | 27 kB 00:00 2020-06-27T04:23:17.662 INFO:teuthology.orchestra.run.smithi017.stdout:(11/36): python3-werkzeug-0.12.2-4.el8.noarch.r 7.6 MB/s | 457 kB 00:00 2020-06-27T04:23:17.726 INFO:teuthology.orchestra.run.smithi017.stdout:(12/36): python3-chardet-3.0.4-7.el8.noarch.rpm 3.0 MB/s | 195 kB 00:00 2020-06-27T04:23:17.763 INFO:teuthology.orchestra.run.smithi017.stdout:(13/36): python3-pysocks-1.6.8-3.el8.noarch.rpm 919 kB/s | 34 kB 00:00 2020-06-27T04:23:17.814 INFO:teuthology.orchestra.run.smithi017.stdout:(14/36): python3-requests-2.20.0-2.1.el8_1.noar 2.4 MB/s | 123 kB 00:00 2020-06-27T04:23:17.855 INFO:teuthology.orchestra.run.smithi017.stdout:(15/36): python3-urllib3-1.24.2-2.el8.noarch.rp 4.2 MB/s | 176 kB 00:00 2020-06-27T04:23:17.936 INFO:teuthology.orchestra.run.smithi017.stdout:(16/36): ceph-mon-16.0.0-2978.g77ddaecfcb0.el8. 3.5 MB/s | 4.9 MB 00:01 2020-06-27T04:23:18.012 INFO:teuthology.orchestra.run.smithi017.stdout:(17/36): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 279 kB/s | 44 kB 00:00 2020-06-27T04:23:18.027 INFO:teuthology.orchestra.run.smithi017.stdout:(18/36): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.0 MB/s | 185 kB 00:00 2020-06-27T04:23:18.075 INFO:teuthology.orchestra.run.smithi017.stdout:(19/36): python3-cherrypy-18.4.0-1.el8.noarch.r 8.0 MB/s | 384 kB 00:00 2020-06-27T04:23:18.096 INFO:teuthology.orchestra.run.smithi017.stdout:(20/36): python3-cssselect-0.9.2-10.el8.noarch. 2.2 MB/s | 40 kB 00:00 2020-06-27T04:23:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:(21/36): python3-cheroot-8.2.1-1.el8.noarch.rpm 1.5 MB/s | 145 kB 00:00 2020-06-27T04:23:18.108 INFO:teuthology.orchestra.run.smithi017.stdout:(22/36): python3-jaraco-6.2-6.el8.noarch.rpm 712 kB/s | 11 kB 00:00 2020-06-27T04:23:18.124 INFO:teuthology.orchestra.run.smithi017.stdout:(23/36): python3-logutils-0.3.5-11.el8.noarch.r 3.0 MB/s | 49 kB 00:00 2020-06-27T04:23:18.125 INFO:teuthology.orchestra.run.smithi017.stdout:(24/36): python3-jaraco-functools-2.0-4.el8.noa 929 kB/s | 18 kB 00:00 2020-06-27T04:23:18.140 INFO:teuthology.orchestra.run.smithi017.stdout:(25/36): python3-more-itertools-7.2.0-3.el8.noa 3.6 MB/s | 59 kB 00:00 2020-06-27T04:23:18.156 INFO:teuthology.orchestra.run.smithi017.stdout:(26/36): python3-portend-2.6-1.el8.noarch.rpm 1.0 MB/s | 16 kB 00:00 2020-06-27T04:23:18.164 INFO:teuthology.orchestra.run.smithi017.stdout:(27/36): python3-pecan-1.3.2-9.el8.noarch.rpm 7.2 MB/s | 283 kB 00:00 2020-06-27T04:23:18.171 INFO:teuthology.orchestra.run.smithi017.stdout:(28/36): python3-simplegeneric-0.8.1-17.el8.noa 1.2 MB/s | 19 kB 00:00 2020-06-27T04:23:18.183 INFO:teuthology.orchestra.run.smithi017.stdout:(29/36): python3-singledispatch-3.4.0.3-18.el8. 1.2 MB/s | 24 kB 00:00 2020-06-27T04:23:18.187 INFO:teuthology.orchestra.run.smithi017.stdout:(30/36): python3-tempora-1.14.1-5.el8.noarch.rp 1.8 MB/s | 29 kB 00:00 2020-06-27T04:23:18.202 INFO:teuthology.orchestra.run.smithi017.stdout:(31/36): python3-trustme-0.5.2-4.el8.noarch.rpm 1.3 MB/s | 26 kB 00:00 2020-06-27T04:23:18.219 INFO:teuthology.orchestra.run.smithi017.stdout:(32/36): python3-waitress-1.2.1-2.el8.1.noarch. 7.5 MB/s | 241 kB 00:00 2020-06-27T04:23:18.235 INFO:teuthology.orchestra.run.smithi017.stdout:(33/36): python3-webtest-2.0.33-1.el8.noarch.rp 5.1 MB/s | 85 kB 00:00 2020-06-27T04:23:18.241 INFO:teuthology.orchestra.run.smithi017.stdout:(34/36): python3-webob-1.8.5-1.el8.1.noarch.rpm 6.4 MB/s | 251 kB 00:00 2020-06-27T04:23:18.251 INFO:teuthology.orchestra.run.smithi017.stdout:(35/36): python3-zc-lockfile-2.0-2.el8.noarch.r 1.4 MB/s | 23 kB 00:00 2020-06-27T04:23:18.695 INFO:teuthology.orchestra.run.smithi017.stdout:(36/36): ceph-osd-16.0.0-2978.g77ddaecfcb0.el8. 12 MB/s | 18 MB 00:01 2020-06-27T04:23:18.697 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:23:18.698 INFO:teuthology.orchestra.run.smithi017.stdout:Total 13 MB/s | 32 MB 00:02 2020-06-27T04:23:18.711 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:23:18.757 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:23:18.757 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:23:19.174 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:23:19.174 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:23:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:23:20.782 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/36 2020-06-27T04:23:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/36 2020-06-27T04:23:21.216 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/36 2020-06-27T04:23:21.439 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/36 2020-06-27T04:23:21.600 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 5/36 2020-06-27T04:23:21.744 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/36 2020-06-27T04:23:21.910 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/36 2020-06-27T04:23:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/36 2020-06-27T04:23:22.237 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/36 2020-06-27T04:23:22.434 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/36 2020-06-27T04:23:22.693 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 11/36 2020-06-27T04:23:22.834 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 12/36 2020-06-27T04:23:22.997 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 13/36 2020-06-27T04:23:23.206 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 14/36 2020-06-27T04:23:23.514 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 15/36 2020-06-27T04:23:23.799 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 16/36 2020-06-27T04:23:24.086 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 17/36 2020-06-27T04:23:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/36 2020-06-27T04:23:24.658 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 19/36 2020-06-27T04:23:24.898 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 20/36 2020-06-27T04:23:25.290 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 21/36 2020-06-27T04:23:25.618 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 22/36 2020-06-27T04:23:25.804 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 23/36 2020-06-27T04:23:25.967 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/36 2020-06-27T04:23:26.135 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 25/36 2020-06-27T04:23:26.388 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-2.6-1.el8.noarch 26/36 2020-06-27T04:23:26.719 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 27/36 2020-06-27T04:23:26.958 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/36 2020-06-27T04:23:27.307 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/36 2020-06-27T04:23:27.609 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 30/36 2020-06-27T04:23:27.987 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-2978.g77ddaecfcb0.e 31/36 2020-06-27T04:23:28.158 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 32/36 2020-06-27T04:23:29.775 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 32/36 2020-06-27T04:23:29.913 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 33/36 2020-06-27T04:23:30.382 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 33/36 2020-06-27T04:23:30.604 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 34/36 2020-06-27T04:23:30.819 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 34/36 2020-06-27T04:23:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 35/36 2020-06-27T04:23:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 35/36 2020-06-27T04:23:31.136 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 36/36 2020-06-27T04:23:31.487 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 36/36 2020-06-27T04:23:31.487 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/36 2020-06-27T04:23:31.487 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2/36 2020-06-27T04:23:31.487 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 3/36 2020-06-27T04:23:31.488 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 4/36 2020-06-27T04:23:31.488 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 5/36 2020-06-27T04:23:31.488 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-2978.g77ddaecfcb0.e 6/36 2020-06-27T04:23:31.488 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/36 2020-06-27T04:23:31.489 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/36 2020-06-27T04:23:31.489 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/36 2020-06-27T04:23:31.489 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/36 2020-06-27T04:23:31.489 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/36 2020-06-27T04:23:31.489 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/36 2020-06-27T04:23:31.490 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/36 2020-06-27T04:23:31.490 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 14/36 2020-06-27T04:23:31.490 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 15/36 2020-06-27T04:23:31.491 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 16/36 2020-06-27T04:23:31.491 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 17/36 2020-06-27T04:23:31.491 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/36 2020-06-27T04:23:31.491 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/36 2020-06-27T04:23:31.492 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 20/36 2020-06-27T04:23:31.492 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 21/36 2020-06-27T04:23:31.492 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 22/36 2020-06-27T04:23:31.492 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 23/36 2020-06-27T04:23:31.492 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 24/36 2020-06-27T04:23:31.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 25/36 2020-06-27T04:23:31.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 26/36 2020-06-27T04:23:31.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 27/36 2020-06-27T04:23:31.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-2.6-1.el8.noarch 28/36 2020-06-27T04:23:31.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 29/36 2020-06-27T04:23:31.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 30/36 2020-06-27T04:23:31.494 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 31/36 2020-06-27T04:23:31.494 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 32/36 2020-06-27T04:23:31.494 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 33/36 2020-06-27T04:23:31.494 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 34/36 2020-06-27T04:23:31.494 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 35/36 2020-06-27T04:23:32.272 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 36/36 2020-06-27T04:23:32.273 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:32.273 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:23:32.273 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:32.273 INFO:teuthology.orchestra.run.smithi017.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-06-27T04:23:32.274 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-06-27T04:23:32.274 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:32.274 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:32.274 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:32.274 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:32.275 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:23:32.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-06-27T04:23:32.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.0.6-13.el8.noarch 2020-06-27T04:23:32.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-06-27T04:23:32.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2017.2-9.el8.noarch 2020-06-27T04:23:32.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-06-27T04:23:32.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-06-27T04:23:32.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-06-27T04:23:32.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-06-27T04:23:32.277 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-06-27T04:23:32.277 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-06-27T04:23:32.277 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-06-27T04:23:32.277 INFO:teuthology.orchestra.run.smithi017.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-06-27T04:23:32.277 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-06-27T04:23:32.278 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-06-27T04:23:32.278 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-6.2-6.el8.noarch 2020-06-27T04:23:32.278 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-06-27T04:23:32.278 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-06-27T04:23:32.279 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-06-27T04:23:32.279 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-06-27T04:23:32.279 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-2.6-1.el8.noarch 2020-06-27T04:23:32.279 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-06-27T04:23:32.279 INFO:teuthology.orchestra.run.smithi017.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-06-27T04:23:32.280 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-06-27T04:23:32.280 INFO:teuthology.orchestra.run.smithi017.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-06-27T04:23:32.280 INFO:teuthology.orchestra.run.smithi017.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-06-27T04:23:32.280 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-06-27T04:23:32.280 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-06-27T04:23:32.281 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-06-27T04:23:32.281 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:32.282 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:23:32.616 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-base 2020-06-27T04:23:33.063 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:06 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:23:33.328 INFO:teuthology.orchestra.run.smithi017.stdout:Package ceph-base-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:23:33.439 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:23:33.440 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2020-06-27T04:23:33.441 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:23:33.587 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install cephadm 2020-06-27T04:23:34.025 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:07 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:23:34.624 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:23:34.625 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:34.625 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2020-06-27T04:23:34.625 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:34.625 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:23:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 48 k 2020-06-27T04:23:34.626 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:34.626 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:23:34.626 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:34.626 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2020-06-27T04:23:34.627 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:34.627 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 48 k 2020-06-27T04:23:34.627 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 175 k 2020-06-27T04:23:34.627 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:23:34.780 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm-16.0.0-2978.g77ddaecfcb0.el8.x86_64.rpm 309 kB/s | 48 kB 00:00 2020-06-27T04:23:34.781 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:23:34.781 INFO:teuthology.orchestra.run.smithi017.stdout:Total 307 kB/s | 48 kB 00:00 2020-06-27T04:23:34.783 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:23:34.792 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:23:34.792 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:23:34.794 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:23:34.794 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:23:34.833 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:23:36.345 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:23:36.519 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:23:36.669 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:23:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:23:36.934 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:36.934 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:23:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:36.935 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:23:37.249 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-immutable-object-cache 2020-06-27T04:23:37.693 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:10 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:23:38.121 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:23:38.122 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:38.122 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2020-06-27T04:23:38.123 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:38.123 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:23:38.123 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 205 k 2020-06-27T04:23:38.123 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:38.123 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:23:38.124 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:38.124 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2020-06-27T04:23:38.124 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:38.124 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 205 k 2020-06-27T04:23:38.125 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 734 k 2020-06-27T04:23:38.125 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:23:38.325 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-immutable-object-cache-16.0.0-2978.g77ddae 1.0 MB/s | 205 kB 00:00 2020-06-27T04:23:38.326 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:23:38.326 INFO:teuthology.orchestra.run.smithi017.stdout:Total 1.0 MB/s | 205 kB 00:00 2020-06-27T04:23:38.328 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:23:38.341 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:23:38.342 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:23:38.394 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:23:38.395 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:23:38.537 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:23:38.712 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-2978.g77ddaecfc 1/1 2020-06-27T04:23:39.045 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-2978.g77ddaecfc 1/1 2020-06-27T04:23:39.320 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-2978.g77ddaecfc 1/1 2020-06-27T04:23:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:39.321 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:23:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:23:39.321 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:39.321 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:23:39.810 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr 2020-06-27T04:23:40.257 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:13 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:23:40.519 INFO:teuthology.orchestra.run.smithi017.stdout:Package ceph-mgr-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:23:40.628 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:23:40.629 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2020-06-27T04:23:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:23:40.796 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-dashboard 2020-06-27T04:23:41.229 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:14 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:23:41.634 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:23:41.635 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:41.635 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2020-06-27T04:23:41.636 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:41.636 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:23:41.636 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 3.5 M 2020-06-27T04:23:41.636 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2020-06-27T04:23:41.636 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards 2020-06-27T04:23:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: noarch 2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 24 k 2020-06-27T04:23:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 8.8 k 2020-06-27T04:23:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2020-06-27T04:23:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-06-27T04:23:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-06-27T04:23:41.638 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:41.638 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:23:41.638 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:41.638 INFO:teuthology.orchestra.run.smithi017.stdout:Install 6 Packages 2020-06-27T04:23:41.638 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:41.639 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 3.8 M 2020-06-27T04:23:41.639 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 17 M 2020-06-27T04:23:41.639 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:23:41.753 INFO:teuthology.orchestra.run.smithi017.stdout:(1/6): ceph-prometheus-alerts-16.0.0-2978.g77dd 76 kB/s | 8.8 kB 00:00 2020-06-27T04:23:41.767 INFO:teuthology.orchestra.run.smithi017.stdout:(2/6): ceph-grafana-dashboards-16.0.0-2978.g77d 185 kB/s | 24 kB 00:00 2020-06-27T04:23:41.782 INFO:teuthology.orchestra.run.smithi017.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2020-06-27T04:23:41.815 INFO:teuthology.orchestra.run.smithi017.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 707 kB/s | 34 kB 00:00 2020-06-27T04:23:41.877 INFO:teuthology.orchestra.run.smithi017.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.0 MB/s | 196 kB 00:00 2020-06-27T04:23:41.999 INFO:teuthology.orchestra.run.smithi017.stdout:(6/6): ceph-mgr-dashboard-16.0.0-2978.g77ddaecf 9.6 MB/s | 3.5 MB 00:00 2020-06-27T04:23:42.001 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:23:42.001 INFO:teuthology.orchestra.run.smithi017.stdout:Total 10 MB/s | 3.8 MB 00:00 2020-06-27T04:23:42.005 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:23:42.014 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:23:42.014 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:23:42.174 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:23:42.175 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:23:42.502 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:23:42.732 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2020-06-27T04:23:42.939 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2020-06-27T04:23:43.121 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2020-06-27T04:23:43.260 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-2978.g77ddaecfcb0.el 4/6 2020-06-27T04:23:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-2978.g77ddaecfcb0.e 5/6 2020-06-27T04:23:44.605 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-2978.g77ddaecfcb0.el8.no 6/6 2020-06-27T04:23:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-2978.g77ddaecfcb0.el8.no 6/6 2020-06-27T04:23:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-2978.g77ddaecfcb0.e 1/6 2020-06-27T04:23:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-2978.g77ddaecfcb0.el8.no 2/6 2020-06-27T04:23:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-2978.g77ddaecfcb0.el 3/6 2020-06-27T04:23:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2020-06-27T04:23:44.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2020-06-27T04:23:45.291 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2020-06-27T04:23:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:45.292 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:23:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:23:45.292 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:23:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:23:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-06-27T04:23:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-06-27T04:23:45.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.4.1-12.el8.noarch 2020-06-27T04:23:45.294 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:45.294 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:23:47.143 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-diskprediction-local 2020-06-27T04:23:47.590 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:20 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:23:47.972 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:23:47.973 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: Package ArchVersion Repository Size 2020-06-27T04:23:47.974 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:47.974 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:23:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 8.6 M 2020-06-27T04:23:47.974 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2020-06-27T04:23:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-06-27T04:23:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-06-27T04:23:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-06-27T04:23:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-06-27T04:23:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-06-27T04:23:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-06-27T04:23:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-06-27T04:23:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:47.976 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:23:47.976 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:47.976 INFO:teuthology.orchestra.run.smithi017.stdout:Install 8 Packages 2020-06-27T04:23:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:47.978 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 37 M 2020-06-27T04:23:47.978 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 205 M 2020-06-27T04:23:47.978 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:23:48.077 INFO:teuthology.orchestra.run.smithi017.stdout:(1/8): openblas-0.3.3-2.el8.x86_64.rpm 43 MB/s | 4.3 MB 00:00 2020-06-27T04:23:48.141 INFO:teuthology.orchestra.run.smithi017.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 59 MB/s | 3.7 MB 00:00 2020-06-27T04:23:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:(3/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2020-06-27T04:23:48.157 INFO:teuthology.orchestra.run.smithi017.stdout:(4/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 15 MB/s | 225 kB 00:00 2020-06-27T04:23:48.167 INFO:teuthology.orchestra.run.smithi017.stdout:(5/8): libgfortran-8.3.1-4.5.el8.x86_64.rpm 54 MB/s | 638 kB 00:00 2020-06-27T04:23:48.171 INFO:teuthology.orchestra.run.smithi017.stdout:(6/8): libquadmath-8.3.1-4.5.el8.x86_64.rpm 42 MB/s | 169 kB 00:00 2020-06-27T04:23:48.380 INFO:teuthology.orchestra.run.smithi017.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.1.0+24 64 MB/s | 15 MB 00:00 2020-06-27T04:23:48.618 INFO:teuthology.orchestra.run.smithi017.stdout:(8/8): ceph-mgr-diskprediction-local-16.0.0-297 13 MB/s | 8.6 MB 00:00 2020-06-27T04:23:48.624 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:23:48.625 INFO:teuthology.orchestra.run.smithi017.stdout:Total 56 MB/s | 37 MB 00:00 2020-06-27T04:23:48.636 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:23:48.656 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:23:48.656 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:23:48.989 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:23:48.989 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:23:49.558 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:23:49.709 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-06-27T04:23:49.863 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-06-27T04:23:50.052 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-06-27T04:23:50.623 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-06-27T04:23:50.819 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.3-2.el8.x86_64 3/8 2020-06-27T04:23:51.403 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 3/8 2020-06-27T04:23:51.560 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-06-27T04:23:52.346 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-06-27T04:23:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-06-27T04:23:52.934 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-06-27T04:23:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-06-27T04:23:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 7/8 2020-06-27T04:23:56.576 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-2978.g77ddaec 8/8 2020-06-27T04:23:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-2978.g77ddaec 8/8 2020-06-27T04:23:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-2978.g77ddaec 1/8 2020-06-27T04:23:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 2/8 2020-06-27T04:23:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-06-27T04:23:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2020-06-27T04:23:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-06-27T04:23:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 6/8 2020-06-27T04:23:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 7/8 2020-06-27T04:23:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 8/8 2020-06-27T04:23:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:57.152 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:23:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:23:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.3-2.el8.x86_64 2020-06-27T04:23:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-06-27T04:23:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-06-27T04:23:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-06-27T04:23:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-06-27T04:23:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-06-27T04:23:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-06-27T04:23:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:57.154 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:23:57.286 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-rook 2020-06-27T04:23:57.723 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:30 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:23:58.123 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:23:58.125 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:58.125 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2020-06-27T04:23:58.125 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:58.125 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:23:58.126 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:23:58.126 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-noarch 27 k 2020-06-27T04:23:58.126 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2020-06-27T04:23:58.126 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2020-06-27T04:23:58.126 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2020-06-27T04:23:58.127 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2020-06-27T04:23:58.127 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2020-06-27T04:23:58.127 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2020-06-27T04:23:58.127 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2020-06-27T04:23:58.127 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-06-27T04:23:58.128 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-06-27T04:23:58.128 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-06-27T04:23:58.128 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-06-27T04:23:58.128 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-06-27T04:23:58.128 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-06-27T04:23:58.129 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:58.129 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:23:58.129 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:23:58.129 INFO:teuthology.orchestra.run.smithi017.stdout:Install 13 Packages 2020-06-27T04:23:58.130 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:23:58.130 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 1.9 M 2020-06-27T04:23:58.130 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 24 M 2020-06-27T04:23:58.131 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:23:58.162 INFO:teuthology.orchestra.run.smithi017.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 814 kB/s | 27 kB 00:00 2020-06-27T04:23:58.163 INFO:teuthology.orchestra.run.smithi017.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 576 kB/s | 20 kB 00:00 2020-06-27T04:23:58.164 INFO:teuthology.orchestra.run.smithi017.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 48 MB/s | 126 kB 00:00 2020-06-27T04:23:58.167 INFO:teuthology.orchestra.run.smithi017.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 44 MB/s | 110 kB 00:00 2020-06-27T04:23:58.167 INFO:teuthology.orchestra.run.smithi017.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 42 MB/s | 155 kB 00:00 2020-06-27T04:23:58.168 INFO:teuthology.orchestra.run.smithi017.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 20 MB/s | 43 kB 00:00 2020-06-27T04:23:58.215 INFO:teuthology.orchestra.run.smithi017.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 704 kB/s | 33 kB 00:00 2020-06-27T04:23:58.225 INFO:teuthology.orchestra.run.smithi017.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 289 kB/s | 16 kB 00:00 2020-06-27T04:23:58.246 INFO:teuthology.orchestra.run.smithi017.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 2.6 MB/s | 81 kB 00:00 2020-06-27T04:23:58.257 INFO:teuthology.orchestra.run.smithi017.stdout:(10/13): ceph-mgr-rook-16.0.0-2978.g77ddaecfcb0 211 kB/s | 27 kB 00:00 2020-06-27T04:23:58.262 INFO:teuthology.orchestra.run.smithi017.stdout:(11/13): python3-rsa-3.4.2-12.el8.noarch.rpm 4.4 MB/s | 73 kB 00:00 2020-06-27T04:23:58.332 INFO:teuthology.orchestra.run.smithi017.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 821 kB/s | 61 kB 00:00 2020-06-27T04:23:58.411 INFO:teuthology.orchestra.run.smithi017.stdout:(13/13): python3-kubernetes-11.0.0-2.el8.noarch 6.2 MB/s | 1.2 MB 00:00 2020-06-27T04:23:58.412 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:23:58.413 INFO:teuthology.orchestra.run.smithi017.stdout:Total 6.7 MB/s | 1.9 MB 00:00 2020-06-27T04:23:58.420 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:23:58.436 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:23:58.436 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:23:58.514 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:23:58.514 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:23:59.052 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:23:59.341 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-06-27T04:23:59.568 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2020-06-27T04:23:59.772 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 3/13 2020-06-27T04:23:59.983 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2020-06-27T04:24:00.158 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2020-06-27T04:24:00.395 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2020-06-27T04:24:00.658 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2020-06-27T04:24:00.892 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2020-06-27T04:24:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2020-06-27T04:24:02.266 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 10/13 2020-06-27T04:24:02.441 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-06-27T04:24:03.418 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2020-06-27T04:24:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:16.0.0-2978.g77ddaecfcb0.el8.noarc 13/13 2020-06-27T04:24:03.804 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-2978.g77ddaecfcb0.el8.noarc 13/13 2020-06-27T04:24:03.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:16.0.0-2978.g77ddaecfcb0.el8.noarc 1/13 2020-06-27T04:24:03.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2020-06-27T04:24:03.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2020-06-27T04:24:03.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2020-06-27T04:24:03.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2020-06-27T04:24:03.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-06-27T04:24:03.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-06-27T04:24:03.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2020-06-27T04:24:03.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-06-27T04:24:03.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2020-06-27T04:24:03.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 11/13 2020-06-27T04:24:03.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 12/13 2020-06-27T04:24:04.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2020-06-27T04:24:04.132 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:04.132 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:24:04.132 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:24:04.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-06-27T04:24:04.132 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-06-27T04:24:04.133 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-06-27T04:24:04.133 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-06-27T04:24:04.133 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-06-27T04:24:04.133 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-06-27T04:24:04.133 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-06-27T04:24:04.134 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-06-27T04:24:04.134 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-06-27T04:24:04.134 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-06-27T04:24:04.134 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-06-27T04:24:04.134 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-06-27T04:24:04.134 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:04.135 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:04.310 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-cephadm 2020-06-27T04:24:04.750 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:37 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:05.136 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:05.137 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:05.137 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2020-06-27T04:24:05.137 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:05.137 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:24:05.138 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:16.0.0-2978.g77ddaecfcb0.el8 ceph-noarch 52 k 2020-06-27T04:24:05.138 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2020-06-27T04:24:05.138 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-06-27T04:24:05.138 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-06-27T04:24:05.138 INFO:teuthology.orchestra.run.smithi017.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-06-27T04:24:05.139 INFO:teuthology.orchestra.run.smithi017.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-06-27T04:24:05.139 INFO:teuthology.orchestra.run.smithi017.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-06-27T04:24:05.139 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:05.139 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:24:05.139 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:05.140 INFO:teuthology.orchestra.run.smithi017.stdout:Install 6 Packages 2020-06-27T04:24:05.140 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:05.140 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 5.8 M 2020-06-27T04:24:05.141 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 24 M 2020-06-27T04:24:05.141 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:24:05.192 INFO:teuthology.orchestra.run.smithi017.stdout:(1/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 9.9 MB/s | 538 kB 00:00 2020-06-27T04:24:05.234 INFO:teuthology.orchestra.run.smithi017.stdout:(2/6): python3-babel-2.5.1-5.el8.noarch.rpm 51 MB/s | 4.8 MB 00:00 2020-06-27T04:24:05.292 INFO:teuthology.orchestra.run.smithi017.stdout:(3/6): ceph-mgr-cephadm-16.0.0-2978.g77ddaecfcb 340 kB/s | 52 kB 00:00 2020-06-27T04:24:05.339 INFO:teuthology.orchestra.run.smithi017.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 145 kB/s | 21 kB 00:00 2020-06-27T04:24:05.358 INFO:teuthology.orchestra.run.smithi017.stdout:(5/6): python3-remoto-1.1.4-4.el8.noarch.rpm 769 kB/s | 48 kB 00:00 2020-06-27T04:24:05.401 INFO:teuthology.orchestra.run.smithi017.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.1 MB/s | 355 kB 00:00 2020-06-27T04:24:05.402 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:24:05.402 INFO:teuthology.orchestra.run.smithi017.stdout:Total 22 MB/s | 5.8 MB 00:00 2020-06-27T04:24:05.407 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:24:05.417 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:24:05.417 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:24:05.499 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:24:05.499 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:24:05.794 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:24:06.073 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2020-06-27T04:24:06.331 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2020-06-27T04:24:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/6 2020-06-27T04:24:07.664 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2020-06-27T04:24:07.882 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2020-06-27T04:24:08.050 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.noar 6/6 2020-06-27T04:24:08.264 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.noar 6/6 2020-06-27T04:24:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.noar 1/6 2020-06-27T04:24:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2020-06-27T04:24:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2020-06-27T04:24:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2020-06-27T04:24:08.266 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2020-06-27T04:24:08.516 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 6/6 2020-06-27T04:24:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:08.517 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:24:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:16.0.0-2978.g77ddaecfcb0.el8.noarch 2020-06-27T04:24:08.517 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.5.1-5.el8.noarch 2020-06-27T04:24:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-06-27T04:24:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: python3-apipkg-1.5-6.el8.noarch 2020-06-27T04:24:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-06-27T04:24:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-06-27T04:24:08.518 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:08.519 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:08.782 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-fuse 2020-06-27T04:24:09.512 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:42 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:09.910 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:09.911 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2020-06-27T04:24:09.912 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:09.912 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:24:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 607 k 2020-06-27T04:24:09.913 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2020-06-27T04:24:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2020-06-27T04:24:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2020-06-27T04:24:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:09.914 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:24:09.915 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:09.915 INFO:teuthology.orchestra.run.smithi017.stdout:Install 3 Packages 2020-06-27T04:24:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:09.916 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 710 k 2020-06-27T04:24:09.916 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 2.2 M 2020-06-27T04:24:09.916 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:24:09.946 INFO:teuthology.orchestra.run.smithi017.stdout:(1/3): fuse-common-3.2.1-12.el8.x86_64.rpm 621 kB/s | 21 kB 00:00 2020-06-27T04:24:09.947 INFO:teuthology.orchestra.run.smithi017.stdout:(2/3): fuse-2.9.7-12.el8.x86_64.rpm 2.3 MB/s | 82 kB 00:00 2020-06-27T04:24:10.138 INFO:teuthology.orchestra.run.smithi017.stdout:(3/3): ceph-fuse-16.0.0-2978.g77ddaecfcb0.el8.x 2.6 MB/s | 607 kB 00:00 2020-06-27T04:24:10.140 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:24:10.140 INFO:teuthology.orchestra.run.smithi017.stdout:Total 3.0 MB/s | 710 kB 00:00 2020-06-27T04:24:10.144 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:24:10.167 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:24:10.167 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:24:10.238 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:24:10.238 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:24:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:24:10.412 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-06-27T04:24:10.413 INFO:teuthology.orchestra.run.smithi017.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-06-27T04:24:10.413 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:10.821 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-06-27T04:24:10.973 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 3/3 2020-06-27T04:24:11.329 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 3/3 2020-06-27T04:24:11.329 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/3 2020-06-27T04:24:11.329 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-06-27T04:24:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-06-27T04:24:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:11.600 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:24:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-06-27T04:24:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-06-27T04:24:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:11.601 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:12.022 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install librados-devel 2020-06-27T04:24:12.470 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:45 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:12.896 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:12.897 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2020-06-27T04:24:12.897 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:12.897 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:24:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 141 k 2020-06-27T04:24:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:12.898 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:24:12.898 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:12.898 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2020-06-27T04:24:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:12.899 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 141 k 2020-06-27T04:24:12.899 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 485 k 2020-06-27T04:24:12.899 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:24:13.075 INFO:teuthology.orchestra.run.smithi017.stdout:librados-devel-16.0.0-2978.g77ddaecfcb0.el8.x86 791 kB/s | 141 kB 00:00 2020-06-27T04:24:13.076 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:24:13.076 INFO:teuthology.orchestra.run.smithi017.stdout:Total 786 kB/s | 141 kB 00:00 2020-06-27T04:24:13.078 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:24:13.086 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:24:13.086 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:24:13.138 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:24:13.139 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:24:13.256 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:24:13.464 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:24:13.669 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:24:13.913 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:24:13.913 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:13.913 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:24:13.914 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:24:13.914 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:13.914 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:14.268 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install libcephfs2 2020-06-27T04:24:14.717 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:47 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:15.121 INFO:teuthology.orchestra.run.smithi017.stdout:Package libcephfs2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:24:15.236 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:15.238 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2020-06-27T04:24:15.239 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:15.393 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install libcephfs-devel 2020-06-27T04:24:15.832 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:48 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:16.218 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:16.219 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:16.219 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2020-06-27T04:24:16.219 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:16.219 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:24:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 23 k 2020-06-27T04:24:16.220 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:16.220 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:24:16.220 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:16.220 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2020-06-27T04:24:16.221 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:16.221 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 23 k 2020-06-27T04:24:16.221 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 84 k 2020-06-27T04:24:16.221 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:24:16.348 INFO:teuthology.orchestra.run.smithi017.stdout:libcephfs-devel-16.0.0-2978.g77ddaecfcb0.el8.x8 182 kB/s | 23 kB 00:00 2020-06-27T04:24:16.349 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:24:16.349 INFO:teuthology.orchestra.run.smithi017.stdout:Total 180 kB/s | 23 kB 00:00 2020-06-27T04:24:16.351 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:24:16.355 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:24:16.355 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:24:16.358 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:24:16.359 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:24:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:24:16.597 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 1/1 2020-06-27T04:24:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 1/1 2020-06-27T04:24:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_6 1/1 2020-06-27T04:24:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:17.079 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:24:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:24:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:17.080 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:17.260 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install librados2 2020-06-27T04:24:17.718 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:50 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:18.001 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:24:18.110 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:18.111 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2020-06-27T04:24:18.111 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:18.288 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install librbd1 2020-06-27T04:24:18.727 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:51 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:19.026 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:24:19.139 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:19.140 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2020-06-27T04:24:19.140 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:19.324 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rados 2020-06-27T04:24:19.766 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:52 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:20.022 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rados-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:24:20.133 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:20.134 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2020-06-27T04:24:20.135 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:20.279 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rgw 2020-06-27T04:24:20.721 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:53 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:21.015 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rgw-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:24:21.129 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:21.130 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2020-06-27T04:24:21.130 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:21.307 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-cephfs 2020-06-27T04:24:21.746 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:54 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-cephfs-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:24:22.116 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:22.117 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2020-06-27T04:24:22.117 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:22.262 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rbd 2020-06-27T04:24:22.705 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:55 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:22.988 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 is already installed. 2020-06-27T04:24:23.104 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:23.104 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2020-06-27T04:24:23.105 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:23.282 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-fuse 2020-06-27T04:24:23.721 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:56 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:24.134 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:24.135 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:24.135 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2020-06-27T04:24:24.135 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:24.135 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:24:24.136 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 90 k 2020-06-27T04:24:24.136 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:24.136 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:24:24.136 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:24.136 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2020-06-27T04:24:24.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:24.137 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 90 k 2020-06-27T04:24:24.137 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 333 k 2020-06-27T04:24:24.137 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:24:24.289 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-fuse-16.0.0-2978.g77ddaecfcb0.el8.x86_64.rp 590 kB/s | 90 kB 00:00 2020-06-27T04:24:24.289 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:24:24.290 INFO:teuthology.orchestra.run.smithi017.stdout:Total 586 kB/s | 90 kB 00:00 2020-06-27T04:24:24.295 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:24:24.304 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:24:24.304 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:24:24.358 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:24:24.359 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:24:24.492 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:24:24.679 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:24:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:24:25.151 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:24:25.152 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:25.152 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:24:25.152 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:24:25.152 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:25.152 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:25.494 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-mirror 2020-06-27T04:24:25.937 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:58 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:26.685 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:26.686 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:26.687 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2020-06-27T04:24:26.687 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:26.687 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:24:26.687 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 2.7 M 2020-06-27T04:24:26.687 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:26.688 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:24:26.688 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2020-06-27T04:24:26.689 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 2.7 M 2020-06-27T04:24:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 12 M 2020-06-27T04:24:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:24:27.016 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-mirror-16.0.0-2978.g77ddaecfcb0.el8.x86_64. 8.3 MB/s | 2.7 MB 00:00 2020-06-27T04:24:27.017 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:24:27.017 INFO:teuthology.orchestra.run.smithi017.stdout:Total 8.2 MB/s | 2.7 MB 00:00 2020-06-27T04:24:27.019 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:24:27.034 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:24:27.035 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:24:27.101 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:24:27.101 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:24:27.889 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:24:28.218 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:24:28.563 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:24:28.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:24:28.804 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:28.805 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:24:28.805 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:24:28.805 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:28.806 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:29.115 INFO:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-nbd 2020-06-27T04:24:29.564 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:02 ago on Sat 27 Jun 2020 04:22:27 AM UTC. 2020-06-27T04:24:29.950 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2020-06-27T04:24:29.951 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:29.952 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2020-06-27T04:24:29.952 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:29.952 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2020-06-27T04:24:29.952 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:16.0.0-2978.g77ddaecfcb0.el8 ceph 164 k 2020-06-27T04:24:29.952 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:29.953 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2020-06-27T04:24:29.954 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2020-06-27T04:24:29.954 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2020-06-27T04:24:29.954 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:29.954 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 164 k 2020-06-27T04:24:29.954 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 645 k 2020-06-27T04:24:29.955 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2020-06-27T04:24:30.130 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-nbd-16.0.0-2978.g77ddaecfcb0.el8.x86_64.rpm 925 kB/s | 164 kB 00:00 2020-06-27T04:24:30.130 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2020-06-27T04:24:30.131 INFO:teuthology.orchestra.run.smithi017.stdout:Total 920 kB/s | 164 kB 00:00 2020-06-27T04:24:30.132 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2020-06-27T04:24:30.145 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2020-06-27T04:24:30.146 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2020-06-27T04:24:30.198 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2020-06-27T04:24:30.198 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2020-06-27T04:24:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2020-06-27T04:24:30.536 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:24:30.743 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-nbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:24:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 1/1 2020-06-27T04:24:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:31.011 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2020-06-27T04:24:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:16.0.0-2978.g77ddaecfcb0.el8.x86_64 2020-06-27T04:24:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:31.011 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2020-06-27T04:24:31.335 DEBUG:teuthology.parallel:result is None 2020-06-27T04:24:31.337 INFO:teuthology.orchestra.run.smithi017:> sudo lsb_release -is 2020-06-27T04:24:31.381 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS 2020-06-27T04:24:31.383 DEBUG:teuthology.misc:System to be installed: CentOS 2020-06-27T04:24:31.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 2020-06-27T04:24:31.573 INFO:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-06-27T04:24:31.596 INFO:teuthology.orchestra.run.smithi017.stdout:16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:24:31.597 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-2978.g77ddaecfcb0.el8 2020-06-27T04:24:31.598 INFO:teuthology.task.install:The correct ceph version 16.0.0-2978.g77ddaecfcb0 is installed. 2020-06-27T04:24:31.598 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-06-27T04:24:31.599 INFO:teuthology.orchestra.run.smithi017:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-06-27T04:24:31.669 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-06-27T04:24:31.670 INFO:teuthology.orchestra.run.smithi017:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-06-27T04:24:31.743 INFO:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-06-27T04:24:31.814 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-06-27T04:24:31.815 INFO:teuthology.orchestra.run.smithi017:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-06-27T04:24:31.900 INFO:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-06-27T04:24:31.972 INFO:teuthology.run_tasks:Running task ceph... 2020-06-27T04:24:32.046 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-06-27T04:24:32.047 INFO:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2020-06-27T04:24:32.079 INFO:tasks.ceph:Disabling ceph logrotate... 2020-06-27T04:24:32.079 INFO:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2020-06-27T04:24:32.150 INFO:tasks.ceph:Creating extra log directories... 2020-06-27T04:24:32.151 INFO:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-06-27T04:24:32.222 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-06-27T04:24:32.222 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-06-27T04:24:32.223 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi/5182928', 'branch': 'wip-kefu-testing-2020-06-26-1211', 'description': 'rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}', 'email': 'tchaikov@gmail.com', 'first_in_suite': False, 'job_id': '5182928', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'kchai-2020-06-27_03:47:06-rados-wip-kefu-testing-2020-06-26-1211-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.1', 'overrides': {'admin_socket': {'branch': 'wip-kefu-testing-2020-06-26-1211'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(OSD_SLOW_PING_TIME'], 'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-kefu-testing-2020-06-26-1211', 'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5'}}, 'owner': 'scheduled_kchai@teuthology', 'priority': 90, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-kefu-testing-2020-06-26-1211', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-06-26-1211/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (1, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'pre-mgr-commands': ['sudo ceph config set mgr mgr/devicehealth/enable_monitoring false --force'], 'conf': {'global': {'mon client directed command retry': 5, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(OSD_SLOW_PING_TIME'], 'sha1': '77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5', 'cluster': 'ceph'}}, {'divergent_priors2': None}], 'teuthology_branch': 'master', 'tube': 'smithi', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.8462', 'targets': {'smithi017.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCotL5iamc31FInm2Xo3DzvoJDCv5jtKNxEQJZbnminqxBOg3hYUaCC17Lzi01agfKNENEKqh6sF8F65PkrXK1pZw4pagAVgmacZFJxlDEixDDGxDDTtdcTswMi1/Yz7GKAFsxa5H+YxUMUuds8Hn+jyEXYbyhQPMLV50mVzIymX+bxGdz5eyb2s643xSV/LRsInB07KwfUHoYBqWeD0jSZyXrtZDNCu+X/ZmNo3f1T9hFWvyJxC4oFoauAveOY+tIWbDTgIqBT7ijEOO8lLFK+AvTLKXK1doHa9peJqv7nmWuJOsKx+A6Z7clpAS9l56CoDAlyM++gxNTfsgavzNibGcgy9cDqZjuZw2ooaaONS2zmBuTcn4pcoh2rVFxXt4gc1+LlcoE18R47oeLt2gouzXINxWkhuFB+BOGHA61mksUmb0lfioxuqdJAsOsNXjJYdI1laTbJoVycTEkYTD3WrKbByDV2pOAgHaVF9574IzIa6YQMPfkxVmG9WEK9C08='}} 2020-06-27T04:24:32.224 INFO:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-06-27T04:24:32.276 INFO:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2020-06-27T04:24:32.430 DEBUG:teuthology.orchestra.remote:smithi017:/scratch_devs is 72B 2020-06-27T04:24:32.478 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-06-27T04:24:32.479 INFO:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-06-27T04:24:32.493 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-06-27T04:24:32.493 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-27T04:24:32.493 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 61668 Links: 1 2020-06-27T04:24:32.494 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-27T04:24:32.494 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2020-06-27T04:24:32.494 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2020-06-27 04:24:28.387979976 +0000 2020-06-27T04:24:32.494 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2020-06-27 04:22:03.794063851 +0000 2020-06-27T04:24:32.494 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2020-06-27 04:22:03.794063851 +0000 2020-06-27T04:24:32.495 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2020-06-27T04:24:32.510 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2020-06-27T04:24:32.510 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2020-06-27T04:24:32.510 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000230261 s, 2.2 MB/s 2020-06-27T04:24:32.513 INFO:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-06-27T04:24:32.567 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-06-27T04:24:32.567 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-27T04:24:32.568 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 56803 Links: 1 2020-06-27T04:24:32.568 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-27T04:24:32.568 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2020-06-27T04:24:32.568 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2020-06-27 04:24:28.388979964 +0000 2020-06-27T04:24:32.568 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2020-06-27 04:22:04.139061040 +0000 2020-06-27T04:24:32.569 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2020-06-27 04:22:04.139061040 +0000 2020-06-27T04:24:32.569 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2020-06-27T04:24:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2020-06-27T04:24:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2020-06-27T04:24:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000267315 s, 1.9 MB/s 2020-06-27T04:24:32.589 INFO:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-06-27T04:24:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-06-27T04:24:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-27T04:24:32.645 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 62735 Links: 1 2020-06-27T04:24:32.645 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-27T04:24:32.645 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2020-06-27T04:24:32.645 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2020-06-27 04:24:28.388979964 +0000 2020-06-27T04:24:32.645 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2020-06-27 04:22:04.497058123 +0000 2020-06-27T04:24:32.646 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2020-06-27 04:22:04.497058123 +0000 2020-06-27T04:24:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2020-06-27T04:24:32.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2020-06-27T04:24:32.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2020-06-27T04:24:32.661 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000214792 s, 2.4 MB/s 2020-06-27T04:24:32.664 INFO:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-06-27T04:24:32.752 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-06-27T04:24:32.753 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-27T04:24:32.753 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 58074 Links: 1 2020-06-27T04:24:32.753 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-27T04:24:32.753 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2020-06-27T04:24:32.753 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2020-06-27 04:24:28.388979964 +0000 2020-06-27T04:24:32.754 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2020-06-27 04:22:04.898054855 +0000 2020-06-27T04:24:32.754 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2020-06-27 04:22:04.898054855 +0000 2020-06-27T04:24:32.754 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2020-06-27T04:24:32.775 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2020-06-27T04:24:32.775 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2020-06-27T04:24:32.775 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000164695 s, 3.1 MB/s 2020-06-27T04:24:32.776 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2020-06-27T04:24:32.776 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2020-06-27T04:24:32.777 INFO:tasks.ceph:Generating config... 2020-06-27T04:24:32.778 INFO:tasks.ceph:[global] mon client directed command retry = 5 2020-06-27T04:24:32.779 INFO:tasks.ceph:[global] ms bind msgr1 = False 2020-06-27T04:24:32.779 INFO:tasks.ceph:[global] ms bind msgr2 = True 2020-06-27T04:24:32.779 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2020-06-27T04:24:32.781 INFO:tasks.ceph:[global] ms type = async 2020-06-27T04:24:32.781 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-06-27T04:24:32.784 INFO:tasks.ceph:[mgr] debug ms = 1 2020-06-27T04:24:32.784 INFO:tasks.ceph:[mon] debug mon = 20 2020-06-27T04:24:32.785 INFO:tasks.ceph:[mon] debug ms = 1 2020-06-27T04:24:32.785 INFO:tasks.ceph:[mon] debug paxos = 20 2020-06-27T04:24:32.786 INFO:tasks.ceph:[osd] bdev async discard = True 2020-06-27T04:24:32.786 INFO:tasks.ceph:[osd] bdev enable discard = True 2020-06-27T04:24:32.786 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2020-06-27T04:24:32.786 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-06-27T04:24:32.787 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-06-27T04:24:32.787 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-06-27T04:24:32.787 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-06-27T04:24:32.788 INFO:tasks.ceph:[osd] debug filestore = 20 2020-06-27T04:24:32.788 INFO:tasks.ceph:[osd] debug journal = 20 2020-06-27T04:24:32.788 INFO:tasks.ceph:[osd] debug ms = 20 2020-06-27T04:24:32.789 INFO:tasks.ceph:[osd] debug osd = 25 2020-06-27T04:24:32.789 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-06-27T04:24:32.789 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-06-27T04:24:32.790 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-06-27T04:24:32.790 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-06-27T04:24:32.790 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2020-06-27T04:24:32.791 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2020-06-27T04:24:32.791 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-06-27T04:24:32.791 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-06-27T04:24:32.791 INFO:tasks.ceph:[osd] osd op queue = debug_random 2020-06-27T04:24:32.792 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2020-06-27T04:24:32.792 INFO:tasks.ceph:Setting up mon.a... 2020-06-27T04:24:32.793 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-06-27T04:24:32.877 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2020-06-27T04:24:32.879 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-06-27T04:24:32.926 INFO:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-06-27T04:24:32.957 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17')] 2020-06-27T04:24:32.958 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.17 --print /home/ubuntu/cephtest/ceph.monmap 2020-06-27T04:24:33.030 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-06-27T04:24:33.030 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid a6b0e6f7-fcc2-46bd-b989-30e0231a9041 2020-06-27T04:24:33.030 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2020-06-27T04:24:33.030 INFO:teuthology.orchestra.run.smithi017.stdout:fsid a6b0e6f7-fcc2-46bd-b989-30e0231a9041 2020-06-27T04:24:33.031 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2020-06-27T04:24:33.028027+0000 2020-06-27T04:24:33.031 INFO:teuthology.orchestra.run.smithi017.stdout:created 2020-06-27T04:24:33.028027+0000 2020-06-27T04:24:33.032 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 0 (unknown) 2020-06-27T04:24:33.032 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2020-06-27T04:24:33.033 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2020-06-27T04:24:33.034 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a6b0e6f7-fcc2-46bd-b989-30e0231a9041... 2020-06-27T04:24:33.035 INFO:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-06-27T04:24:33.139 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2020-06-27T04:24:33.140 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2020-06-27T04:24:33.140 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-06-27T04:24:33.141 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2020-06-27T04:24:33.141 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.141 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2020-06-27T04:24:33.141 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.141 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2020-06-27T04:24:33.142 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.142 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2020-06-27T04:24:33.142 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2020-06-27T04:24:33.142 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.142 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2020-06-27T04:24:33.142 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2020-06-27T04:24:33.143 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.143 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2020-06-27T04:24:33.143 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2020-06-27T04:24:33.143 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.143 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2020-06-27T04:24:33.144 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2020-06-27T04:24:33.144 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.144 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2020-06-27T04:24:33.144 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.144 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2020-06-27T04:24:33.145 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2020-06-27T04:24:33.145 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2020-06-27T04:24:33.145 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2020-06-27T04:24:33.145 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2020-06-27T04:24:33.145 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2020-06-27T04:24:33.145 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2020-06-27T04:24:33.146 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-06-27T04:24:33.146 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2020-06-27T04:24:33.146 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2020-06-27T04:24:33.146 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.146 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-06-27T04:24:33.147 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.147 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2020-06-27T04:24:33.147 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.147 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2020-06-27T04:24:33.147 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.147 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2020-06-27T04:24:33.148 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2020-06-27T04:24:33.148 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = 172.21.15.17 2020-06-27T04:24:33.148 INFO:teuthology.orchestra.run.smithi017.stdout: mon client directed command retry = 5 2020-06-27T04:24:33.148 INFO:teuthology.orchestra.run.smithi017.stdout: ms bind msgr1 = False 2020-06-27T04:24:33.148 INFO:teuthology.orchestra.run.smithi017.stdout: ms bind msgr2 = True 2020-06-27T04:24:33.149 INFO:teuthology.orchestra.run.smithi017.stdout: ms inject socket failures = 5000 2020-06-27T04:24:33.149 INFO:teuthology.orchestra.run.smithi017.stdout: ms type = async 2020-06-27T04:24:33.149 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = a6b0e6f7-fcc2-46bd-b989-30e0231a9041 2020-06-27T04:24:33.149 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.149 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2020-06-27T04:24:33.149 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2020-06-27T04:24:33.150 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.150 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2020-06-27T04:24:33.150 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2020-06-27T04:24:33.150 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.150 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2020-06-27T04:24:33.151 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2020-06-27T04:24:33.151 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.151 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2020-06-27T04:24:33.151 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2020-06-27T04:24:33.151 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2020-06-27T04:24:33.151 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.152 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2020-06-27T04:24:33.152 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2020-06-27T04:24:33.152 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.152 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2020-06-27T04:24:33.152 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.153 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2020-06-27T04:24:33.153 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.153 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2020-06-27T04:24:33.153 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.153 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2020-06-27T04:24:33.153 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2020-06-27T04:24:33.154 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.154 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2020-06-27T04:24:33.154 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2020-06-27T04:24:33.154 INFO:teuthology.orchestra.run.smithi017.stdout: bdev async discard = True 2020-06-27T04:24:33.154 INFO:teuthology.orchestra.run.smithi017.stdout: bdev enable discard = True 2020-06-27T04:24:33.155 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore allocator = bitmap 2020-06-27T04:24:33.155 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2020-06-27T04:24:33.155 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2020-06-27T04:24:33.155 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 20 2020-06-27T04:24:33.155 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 20 2020-06-27T04:24:33.155 INFO:teuthology.orchestra.run.smithi017.stdout: debug filestore = 20 2020-06-27T04:24:33.156 INFO:teuthology.orchestra.run.smithi017.stdout: debug journal = 20 2020-06-27T04:24:33.156 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 20 2020-06-27T04:24:33.156 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 25 2020-06-27T04:24:33.156 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 10 2020-06-27T04:24:33.156 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2020-06-27T04:24:33.157 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2020-06-27T04:24:33.157 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2020-06-27T04:24:33.157 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify cached snaps = True 2020-06-27T04:24:33.157 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify missing on start = True 2020-06-27T04:24:33.157 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2020-06-27T04:24:33.157 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2020-06-27T04:24:33.158 INFO:teuthology.orchestra.run.smithi017.stdout: osd op queue = debug_random 2020-06-27T04:24:33.158 INFO:teuthology.orchestra.run.smithi017.stdout: osd op queue cut off = debug_random 2020-06-27T04:24:33.158 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.158 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2020-06-27T04:24:33.158 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2020-06-27T04:24:33.159 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2020-06-27T04:24:33.159 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2020-06-27T04:24:33.159 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2020-06-27T04:24:33.159 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2020-06-27T04:24:33.159 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2020-06-27T04:24:33.159 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2020-06-27T04:24:33.160 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.160 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2020-06-27T04:24:33.160 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2020-06-27T04:24:33.160 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2020-06-27T04:24:33.160 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2020-06-27T04:24:33.161 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2020-06-27T04:24:33.161 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2020-06-27T04:24:33.161 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2020-06-27T04:24:33.161 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2020-06-27T04:24:33.161 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2020-06-27T04:24:33.161 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2020-06-27T04:24:33.162 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2020-06-27T04:24:33.162 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:33.162 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2020-06-27T04:24:33.162 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2020-06-27T04:24:33.162 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2020-06-27T04:24:33.163 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2020-06-27T04:24:33.163 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-06-27T04:24:33.163 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-06-27T04:24:33.163 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2020-06-27T04:24:33.164 INFO:tasks.ceph:Creating admin key on mon.a... 2020-06-27T04:24:33.165 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-06-27T04:24:33.228 INFO:tasks.ceph:Copying monmap to all nodes... 2020-06-27T04:24:33.246 DEBUG:teuthology.orchestra.remote:smithi017:/etc/ceph/ceph.keyring is 206B 2020-06-27T04:24:33.341 DEBUG:teuthology.orchestra.remote:smithi017:/home/ubuntu/cephtest/ceph.monmap is 179B 2020-06-27T04:24:33.390 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2020-06-27T04:24:33.390 INFO:teuthology.orchestra.run.smithi017:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-06-27T04:24:33.453 INFO:teuthology.orchestra.run.smithi017:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-06-27T04:24:33.538 INFO:tasks.ceph:Setting up mon nodes... 2020-06-27T04:24:33.538 INFO:tasks.ceph:Setting up mgr nodes... 2020-06-27T04:24:33.539 INFO:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-06-27T04:24:33.639 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-06-27T04:24:33.641 INFO:tasks.ceph:Setting up mds nodes... 2020-06-27T04:24:33.641 INFO:tasks.ceph_client:Setting up client nodes... 2020-06-27T04:24:33.642 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-06-27T04:24:33.686 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-06-27T04:24:33.705 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-06-27T04:24:33.706 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2020-06-27T04:24:33.706 INFO:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-06-27T04:24:33.739 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2020-06-27T04:24:33.740 INFO:tasks.ceph:role: osd.0 2020-06-27T04:24:33.740 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com 2020-06-27T04:24:33.740 INFO:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-06-27T04:24:34.262 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-06-27T04:24:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-27T04:24:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-06-27T04:24:34.263 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 2020-06-27T04:24:34.264 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-27T04:24:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2020-06-27T04:24:34.264 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-06-27T04:24:34.264 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-27T04:24:34.264 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-27T04:24:34.264 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-27T04:24:34.265 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2020-06-27T04:24:34.266 INFO:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-06-27T04:24:34.380 INFO:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-06-27T04:24:34.416 INFO:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-06-27T04:24:34.487 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2020-06-27T04:24:34.487 INFO:tasks.ceph:role: osd.1 2020-06-27T04:24:34.488 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com 2020-06-27T04:24:34.488 INFO:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-06-27T04:24:34.998 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-06-27T04:24:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-27T04:24:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-06-27T04:24:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 2020-06-27T04:24:34.999 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-27T04:24:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2020-06-27T04:24:34.999 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-06-27T04:24:34.999 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-27T04:24:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-27T04:24:35.000 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-27T04:24:35.001 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2020-06-27T04:24:35.001 INFO:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2020-06-27T04:24:35.051 INFO:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-06-27T04:24:35.087 INFO:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-06-27T04:24:35.158 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2020-06-27T04:24:35.159 INFO:tasks.ceph:role: osd.2 2020-06-27T04:24:35.159 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com 2020-06-27T04:24:35.159 INFO:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-06-27T04:24:35.686 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-06-27T04:24:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-27T04:24:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-06-27T04:24:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 2020-06-27T04:24:35.687 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-27T04:24:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2020-06-27T04:24:35.688 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-06-27T04:24:35.688 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-27T04:24:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-27T04:24:35.688 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-27T04:24:35.689 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2020-06-27T04:24:35.690 INFO:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2020-06-27T04:24:35.760 INFO:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-06-27T04:24:35.795 INFO:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-27T04:24:35.883 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:35.879+0000 7fbecfd88ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-06-27T04:24:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:35.881+0000 7fbecfd88ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-06-27T04:24:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:35.881+0000 7fbecfd88ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-06-27T04:24:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:35.881+0000 7fbecfd88ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-06-27T04:24:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:35.881+0000 7fbecfd88ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-06-27T04:24:35.888 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:35.885+0000 7fbecfd88ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-06-27T04:24:38.232 INFO:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-27T04:24:38.274 INFO:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-27T04:24:38.370 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:38.364+0000 7f12abe0bec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-06-27T04:24:38.371 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:38.364+0000 7f12abe0bec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-06-27T04:24:38.371 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:38.364+0000 7f12abe0bec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-06-27T04:24:38.371 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:38.364+0000 7f12abe0bec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-06-27T04:24:38.372 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:38.364+0000 7f12abe0bec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-06-27T04:24:38.372 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:38.365+0000 7f12abe0bec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-06-27T04:24:40.720 INFO:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-27T04:24:40.761 INFO:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-27T04:24:40.855 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:40.851+0000 7f1e07dc6ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-06-27T04:24:40.855 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:40.852+0000 7f1e07dc6ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-06-27T04:24:40.855 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:40.852+0000 7f1e07dc6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-06-27T04:24:40.856 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:40.852+0000 7f1e07dc6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-06-27T04:24:40.856 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:40.852+0000 7f1e07dc6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-06-27T04:24:40.856 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:24:40.852+0000 7f1e07dc6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-06-27T04:24:43.199 INFO:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-27T04:24:43.267 INFO:tasks.ceph:Reading keys from all nodes... 2020-06-27T04:24:43.268 INFO:teuthology.orchestra.run.smithi017:> mktemp 2020-06-27T04:24:43.337 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.nltdTop6vk 2020-06-27T04:24:43.343 INFO:teuthology.orchestra.run.smithi017:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.nltdTop6vk 2020-06-27T04:24:43.425 INFO:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.nltdTop6vk 2020-06-27T04:24:43.579 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.nltdTop6vk is 56B 2020-06-27T04:24:43.633 INFO:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.nltdTop6vk 2020-06-27T04:24:43.651 INFO:teuthology.orchestra.run.smithi017:> mktemp 2020-06-27T04:24:43.706 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.1KAS8slbID 2020-06-27T04:24:43.707 INFO:teuthology.orchestra.run.smithi017:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.1KAS8slbID 2020-06-27T04:24:43.789 INFO:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.1KAS8slbID 2020-06-27T04:24:43.920 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.1KAS8slbID is 56B 2020-06-27T04:24:43.945 INFO:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.1KAS8slbID 2020-06-27T04:24:43.972 INFO:teuthology.orchestra.run.smithi017:> mktemp 2020-06-27T04:24:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.1GHERFczeQ 2020-06-27T04:24:44.026 INFO:teuthology.orchestra.run.smithi017:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.1GHERFczeQ 2020-06-27T04:24:44.100 INFO:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.1GHERFczeQ 2020-06-27T04:24:44.232 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.1GHERFczeQ is 56B 2020-06-27T04:24:44.283 INFO:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.1GHERFczeQ 2020-06-27T04:24:44.299 INFO:teuthology.orchestra.run.smithi017:> mktemp 2020-06-27T04:24:44.352 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.fBnEYxDKex 2020-06-27T04:24:44.353 INFO:teuthology.orchestra.run.smithi017:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.fBnEYxDKex 2020-06-27T04:24:44.426 INFO:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.fBnEYxDKex 2020-06-27T04:24:44.561 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.fBnEYxDKex is 56B 2020-06-27T04:24:44.625 INFO:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.fBnEYxDKex 2020-06-27T04:24:44.697 DEBUG:teuthology.orchestra.remote:smithi017:/etc/ceph/ceph.client.0.keyring is 59B 2020-06-27T04:24:44.745 INFO:tasks.ceph:Adding keys to all mons... 2020-06-27T04:24:44.746 INFO:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2020-06-27T04:24:44.789 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2020-06-27T04:24:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAByvZeBQL9JRAAgUtXy6m4pgMRPGK5vMriSw== 2020-06-27T04:24:44.790 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2020-06-27T04:24:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQADyvZeo4qFNBAANcNA8xGBioA3sB+xfVlnWQ== 2020-06-27T04:24:44.795 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2020-06-27T04:24:44.795 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAGyvZe2onOFRAAeq4VC3g9j3LilE3pIuaZsA== 2020-06-27T04:24:44.795 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2020-06-27T04:24:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAIyvZey8LYMhAAm/LJUBG0ynubVIvLxNhsaQ== 2020-06-27T04:24:44.796 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2020-06-27T04:24:44.796 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAByvZe2a3OKBAAJdvFowsndZKikHrOeM8OYw== 2020-06-27T04:24:44.797 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-06-27T04:24:44.890 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-27T04:24:44.943 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-27T04:24:45.000 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-27T04:24:45.063 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-27T04:24:45.119 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-06-27T04:24:45.119 INFO:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-06-27T04:24:45.151 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-06-27T04:24:45.250 INFO:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-06-27T04:24:45.286 INFO:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-06-27T04:24:45.340 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-06-27T04:24:45.341 INFO:tasks.ceph.mon.a:Restarting daemon 2020-06-27T04:24:45.341 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-06-27T04:24:45.382 INFO:tasks.ceph.mon.a:Started 2020-06-27T04:24:45.383 INFO:teuthology.orchestra.run.smithi017:> sudo ceph config set mgr mgr/devicehealth/enable_monitoring false --force 2020-06-27T04:24:45.591 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-06-27T04:24:45.591 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-06-27T04:24:45.592 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-06-27T04:24:45.594 INFO:tasks.ceph.mgr.x:Started 2020-06-27T04:24:45.594 INFO:tasks.ceph:Setting crush tunables to default 2020-06-27T04:24:45.595 INFO:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2020-06-27T04:24:45.802 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2020-06-27T04:24:45.816 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-06-27T04:24:45.817 INFO:teuthology.orchestra.run.smithi017:> mktemp 2020-06-27T04:24:45.839 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.yUVpFcgYXG 2020-06-27T04:24:45.840 INFO:teuthology.orchestra.run.smithi017:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.yUVpFcgYXG 2020-06-27T04:24:45.911 INFO:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.yUVpFcgYXG 2020-06-27T04:24:46.045 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.yUVpFcgYXG is 37B 2020-06-27T04:24:46.092 INFO:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.yUVpFcgYXG 2020-06-27T04:24:46.107 INFO:teuthology.orchestra.run.smithi017:> mktemp 2020-06-27T04:24:46.160 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.FTwJ8oooja 2020-06-27T04:24:46.161 INFO:teuthology.orchestra.run.smithi017:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.FTwJ8oooja 2020-06-27T04:24:46.231 INFO:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.FTwJ8oooja 2020-06-27T04:24:46.364 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.FTwJ8oooja is 37B 2020-06-27T04:24:46.416 INFO:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.FTwJ8oooja 2020-06-27T04:24:46.434 INFO:teuthology.orchestra.run.smithi017:> mktemp 2020-06-27T04:24:46.485 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.pMIlrrH9YG 2020-06-27T04:24:46.485 INFO:teuthology.orchestra.run.smithi017:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.pMIlrrH9YG 2020-06-27T04:24:46.557 INFO:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.pMIlrrH9YG 2020-06-27T04:24:46.686 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.pMIlrrH9YG is 37B 2020-06-27T04:24:46.733 INFO:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.pMIlrrH9YG 2020-06-27T04:24:46.777 INFO:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd new 16e45fbd-d858-41fe-8a73-6f302f4fec59 0 2020-06-27T04:24:47.031 INFO:teuthology.orchestra.run.smithi017.stdout:0 2020-06-27T04:24:47.042 INFO:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd new 17c4bc0d-e539-4f38-afb6-95e2448c5196 1 2020-06-27T04:24:47.253 INFO:teuthology.orchestra.run.smithi017.stdout:1 2020-06-27T04:24:47.265 INFO:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd new 6c978f34-7b4f-4b96-8797-53ac8648d0d3 2 2020-06-27T04:24:47.475 INFO:teuthology.orchestra.run.smithi017.stdout:2 2020-06-27T04:24:47.486 INFO:tasks.ceph.osd.0:Restarting daemon 2020-06-27T04:24:47.487 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-06-27T04:24:47.489 INFO:tasks.ceph.osd.0:Started 2020-06-27T04:24:47.489 INFO:tasks.ceph.osd.1:Restarting daemon 2020-06-27T04:24:47.490 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-06-27T04:24:47.492 INFO:tasks.ceph.osd.1:Started 2020-06-27T04:24:47.492 INFO:tasks.ceph.osd.2:Restarting daemon 2020-06-27T04:24:47.493 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-06-27T04:24:47.495 INFO:tasks.ceph.osd.2:Started 2020-06-27T04:24:47.495 INFO:tasks.ceph:Waiting for OSDs to come up 2020-06-27T04:24:47.801 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-06-27T04:24:47.979 INFO:teuthology.misc.health.smithi017.stdout: 2020-06-27T04:24:47.979 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":5,"fsid":"a6b0e6f7-fcc2-46bd-b989-30e0231a9041","created":"2020-06-27T04:24:45.487818+0000","modified":"2020-06-27T04:24:47.472158+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"16e45fbd-d858-41fe-8a73-6f302f4fec59","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"17c4bc0d-e539-4f38-afb6-95e2448c5196","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6c978f34-7b4f-4b96-8797-53ac8648d0d3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-27T04:24:47.995 DEBUG:teuthology.misc:0 of 3 OSDs are up 2020-06-27T04:24:48.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:24:48.087+0000 7fe38cf72ec0 -1 Falling back to public interface 2020-06-27T04:24:48.092 INFO:tasks.ceph.osd.1.smithi017.stderr:2020-06-27T04:24:48.087+0000 7f1ca596dec0 -1 Falling back to public interface 2020-06-27T04:24:48.092 INFO:tasks.ceph.osd.1.smithi017.stderr:2020-06-27T04:24:48.087+0000 7f1c9f986700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2020-06-27T04:24:48.114 INFO:tasks.ceph.osd.2.smithi017.stderr:2020-06-27T04:24:48.111+0000 7f27bb0b4ec0 -1 Falling back to public interface 2020-06-27T04:24:49.162 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:24:49.158+0000 7fe38cf72ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-06-27T04:24:49.171 INFO:tasks.ceph.osd.1.smithi017.stderr:2020-06-27T04:24:49.167+0000 7f1ca596dec0 -1 osd.1 0 log_to_monitors {default=true} 2020-06-27T04:24:49.198 INFO:tasks.ceph.osd.2.smithi017.stderr:2020-06-27T04:24:49.195+0000 7f27bb0b4ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-06-27T04:24:51.055 INFO:tasks.ceph.osd.1.smithi017.stderr:2020-06-27T04:24:51.051+0000 7f1c9c17f700 -1 osd.1 0 waiting for initial osdmap 2020-06-27T04:24:51.055 INFO:tasks.ceph.osd.2.smithi017.stderr:2020-06-27T04:24:51.051+0000 7f27b18c6700 -1 osd.2 0 waiting for initial osdmap 2020-06-27T04:24:51.056 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:24:51.051+0000 7fe384f87700 -1 osd.0 0 waiting for initial osdmap 2020-06-27T04:24:54.300 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-06-27T04:24:54.574 INFO:teuthology.misc.health.smithi017.stdout: 2020-06-27T04:24:54.575 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":9,"fsid":"a6b0e6f7-fcc2-46bd-b989-30e0231a9041","created":"2020-06-27T04:24:45.487818+0000","modified":"2020-06-27T04:24:53.057665+0000","last_up_change":"2020-06-27T04:24:52.047186+0000","last_in_change":"2020-06-27T04:24:52.047186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"16e45fbd-d858-41fe-8a73-6f302f4fec59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":20828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":20828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":20828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":20828}]},"public_addr":"172.21.15.17:6800/20828","cluster_addr":"172.21.15.17:6802/20828","heartbeat_back_addr":"172.21.15.17:6806/20828","heartbeat_front_addr":"172.21.15.17:6804/20828","state":["exists","up"]},{"osd":1,"uuid":"17c4bc0d-e539-4f38-afb6-95e2448c5196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6801","nonce":20827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6803","nonce":20827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6807","nonce":20827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6805","nonce":20827}]},"public_addr":"172.21.15.17:6801/20827","cluster_addr":"172.21.15.17:6803/20827","heartbeat_back_addr":"172.21.15.17:6807/20827","heartbeat_front_addr":"172.21.15.17:6805/20827","state":["exists","up"]},{"osd":2,"uuid":"6c978f34-7b4f-4b96-8797-53ac8648d0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":20857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":20857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6811","nonce":20857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":20857}]},"public_addr":"172.21.15.17:6808/20857","cluster_addr":"172.21.15.17:6809/20857","heartbeat_back_addr":"172.21.15.17:6811/20857","heartbeat_front_addr":"172.21.15.17:6810/20857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.168668+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.120691+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.201967+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-27T04:24:54.585 DEBUG:teuthology.misc:3 of 3 OSDs are up 2020-06-27T04:24:54.585 INFO:tasks.ceph:Creating RBD pool 2020-06-27T04:24:54.586 INFO:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool create rbd 8 2020-06-27T04:24:55.075 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'rbd' created 2020-06-27T04:24:55.086 INFO:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-06-27T04:24:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:enabled application 'rbd' on pool 'rbd' 2020-06-27T04:24:56.092 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-06-27T04:24:56.093 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-27T04:24:56.094 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-06-27T04:24:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:56.380 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":11,"fsid":"a6b0e6f7-fcc2-46bd-b989-30e0231a9041","created":"2020-06-27T04:24:45.487818+0000","modified":"2020-06-27T04:24:56.066200+0000","last_up_change":"2020-06-27T04:24:52.047186+0000","last_in_change":"2020-06-27T04:24:52.047186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-06-27T04:24:54.904562+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"16e45fbd-d858-41fe-8a73-6f302f4fec59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":20828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":20828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":20828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":20828}]},"public_addr":"172.21.15.17:6800/20828","cluster_addr":"172.21.15.17:6802/20828","heartbeat_back_addr":"172.21.15.17:6806/20828","heartbeat_front_addr":"172.21.15.17:6804/20828","state":["exists","up"]},{"osd":1,"uuid":"17c4bc0d-e539-4f38-afb6-95e2448c5196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6801","nonce":20827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6803","nonce":20827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6807","nonce":20827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6805","nonce":20827}]},"public_addr":"172.21.15.17:6801/20827","cluster_addr":"172.21.15.17:6803/20827","heartbeat_back_addr":"172.21.15.17:6807/20827","heartbeat_front_addr":"172.21.15.17:6805/20827","state":["exists","up"]},{"osd":2,"uuid":"6c978f34-7b4f-4b96-8797-53ac8648d0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":20857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":20857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6811","nonce":20857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":20857}]},"public_addr":"172.21.15.17:6808/20857","cluster_addr":"172.21.15.17:6809/20857","heartbeat_back_addr":"172.21.15.17:6811/20857","heartbeat_front_addr":"172.21.15.17:6810/20857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.168668+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.120691+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.201967+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-27T04:24:56.391 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2020-06-27T04:24:54.904562+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-06-27T04:24:56.391 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-27T04:24:56.672 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2020-06-27T04:24:56.685 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-06-27T04:24:56.685 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-06-27T04:24:56.686 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-06-27T04:24:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:57.017 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":4,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":20305}]},"active_addr":"172.21.15.17:6812/20305","active_change":"2020-06-27T04:24:49.020987+0000","active_mgr_features":4540138292837744639,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1147656590}]},{"addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2224094838}]}]}} 2020-06-27T04:24:57.023 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-06-27T04:24:57.023 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-06-27T04:24:57.024 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-27T04:24:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":12,"fsid":"a6b0e6f7-fcc2-46bd-b989-30e0231a9041","created":"2020-06-27T04:24:45.487818+0000","modified":"2020-06-27T04:24:57.072684+0000","last_up_change":"2020-06-27T04:24:52.047186+0000","last_in_change":"2020-06-27T04:24:52.047186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-06-27T04:24:54.904562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"16e45fbd-d858-41fe-8a73-6f302f4fec59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":20828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":20828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":20828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":20828}]},"public_addr":"172.21.15.17:6800/20828","cluster_addr":"172.21.15.17:6802/20828","heartbeat_back_addr":"172.21.15.17:6806/20828","heartbeat_front_addr":"172.21.15.17:6804/20828","state":["exists","up"]},{"osd":1,"uuid":"17c4bc0d-e539-4f38-afb6-95e2448c5196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6801","nonce":20827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6803","nonce":20827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6807","nonce":20827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6805","nonce":20827}]},"public_addr":"172.21.15.17:6801/20827","cluster_addr":"172.21.15.17:6803/20827","heartbeat_back_addr":"172.21.15.17:6807/20827","heartbeat_front_addr":"172.21.15.17:6805/20827","state":["exists","up"]},{"osd":2,"uuid":"6c978f34-7b4f-4b96-8797-53ac8648d0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":20857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":20857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6811","nonce":20857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":20857}]},"public_addr":"172.21.15.17:6808/20857","cluster_addr":"172.21.15.17:6809/20857","heartbeat_back_addr":"172.21.15.17:6811/20857","heartbeat_front_addr":"172.21.15.17:6810/20857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.168668+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.120691+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.201967+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-27T04:24:57.316 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-06-27T04:24:57.316 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-27T04:24:57.593 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:24:57.593 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":12,"fsid":"a6b0e6f7-fcc2-46bd-b989-30e0231a9041","created":"2020-06-27T04:24:45.487818+0000","modified":"2020-06-27T04:24:57.072684+0000","last_up_change":"2020-06-27T04:24:52.047186+0000","last_in_change":"2020-06-27T04:24:52.047186+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-06-27T04:24:54.904562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"16e45fbd-d858-41fe-8a73-6f302f4fec59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":20828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":20828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":20828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":20828}]},"public_addr":"172.21.15.17:6800/20828","cluster_addr":"172.21.15.17:6802/20828","heartbeat_back_addr":"172.21.15.17:6806/20828","heartbeat_front_addr":"172.21.15.17:6804/20828","state":["exists","up"]},{"osd":1,"uuid":"17c4bc0d-e539-4f38-afb6-95e2448c5196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6801","nonce":20827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6803","nonce":20827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6807","nonce":20827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6805","nonce":20827}]},"public_addr":"172.21.15.17:6801/20827","cluster_addr":"172.21.15.17:6803/20827","heartbeat_back_addr":"172.21.15.17:6807/20827","heartbeat_front_addr":"172.21.15.17:6805/20827","state":["exists","up"]},{"osd":2,"uuid":"6c978f34-7b4f-4b96-8797-53ac8648d0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":20857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":20857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6811","nonce":20857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":20857}]},"public_addr":"172.21.15.17:6808/20857","cluster_addr":"172.21.15.17:6809/20857","heartbeat_back_addr":"172.21.15.17:6811/20857","heartbeat_front_addr":"172.21.15.17:6810/20857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.168668+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.120691+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.201967+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-27T04:24:57.605 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-06-27T04:24:57.754 INFO:teuthology.orchestra.run.smithi017.stdout:34359738372 2020-06-27T04:24:57.755 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-06-27T04:24:57.904 INFO:teuthology.orchestra.run.smithi017.stdout:34359738372 2020-06-27T04:24:57.904 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-06-27T04:24:58.054 INFO:teuthology.orchestra.run.smithi017.stdout:34359738372 2020-06-27T04:24:58.054 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-06-27T04:24:58.335 INFO:teuthology.orchestra.run.smithi017.stdout:34359738370 2020-06-27T04:24:58.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738370 for osd.0 2020-06-27T04:24:59.348 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-06-27T04:24:59.639 INFO:teuthology.orchestra.run.smithi017.stdout:34359738372 2020-06-27T04:24:59.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.0 2020-06-27T04:24:59.651 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-06-27T04:24:59.937 INFO:teuthology.orchestra.run.smithi017.stdout:34359738372 2020-06-27T04:24:59.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.1 2020-06-27T04:24:59.943 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-06-27T04:25:00.223 INFO:teuthology.orchestra.run.smithi017.stdout:34359738373 2020-06-27T04:25:00.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738373 for osd.2 2020-06-27T04:25:00.235 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-06-27T04:25:00.236 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-27T04:25:00.517 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:25:00.518 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2020-06-27T04:25:00.530 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2020-06-27T04:24:59.025011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146048,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969472,"statfs":{"total":289910292480,"available":286688739328,"internally_reserved":3221225472,"allocated":303104,"data_stored":67454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.075413+0000","last_change":"2020-06-27T04:24:56.075413+0000","last_active":"2020-06-27T04:24:56.075413+0000","last_peered":"2020-06-27T04:24:56.075413+0000","last_clean":"2020-06-27T04:24:56.075413+0000","last_became_active":"2020-06-27T04:24:56.075003+0000","last_became_peered":"2020-06-27T04:24:56.075003+0000","last_unstale":"2020-06-27T04:24:56.075413+0000","last_undegraded":"2020-06-27T04:24:56.075413+0000","last_fullsized":"2020-06-27T04:24:56.075413+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.077641+0000","last_change":"2020-06-27T04:24:56.077641+0000","last_active":"2020-06-27T04:24:56.077641+0000","last_peered":"2020-06-27T04:24:56.077641+0000","last_clean":"2020-06-27T04:24:56.077641+0000","last_became_active":"2020-06-27T04:24:56.077234+0000","last_became_peered":"2020-06-27T04:24:56.077234+0000","last_unstale":"2020-06-27T04:24:56.077641+0000","last_undegraded":"2020-06-27T04:24:56.077641+0000","last_fullsized":"2020-06-27T04:24:56.077641+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.078132+0000","last_change":"2020-06-27T04:24:56.076999+0000","last_active":"2020-06-27T04:24:56.078132+0000","last_peered":"2020-06-27T04:24:56.078132+0000","last_clean":"2020-06-27T04:24:56.078132+0000","last_became_active":"2020-06-27T04:24:56.076651+0000","last_became_peered":"2020-06-27T04:24:56.076651+0000","last_unstale":"2020-06-27T04:24:56.078132+0000","last_undegraded":"2020-06-27T04:24:56.078132+0000","last_fullsized":"2020-06-27T04:24:56.078132+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.074118+0000","last_change":"2020-06-27T04:24:56.074118+0000","last_active":"2020-06-27T04:24:56.074118+0000","last_peered":"2020-06-27T04:24:56.074118+0000","last_clean":"2020-06-27T04:24:56.074118+0000","last_became_active":"2020-06-27T04:24:56.073721+0000","last_became_peered":"2020-06-27T04:24:56.073721+0000","last_unstale":"2020-06-27T04:24:56.074118+0000","last_undegraded":"2020-06-27T04:24:56.074118+0000","last_fullsized":"2020-06-27T04:24:56.074118+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.074612+0000","last_change":"2020-06-27T04:24:56.074612+0000","last_active":"2020-06-27T04:24:56.074612+0000","last_peered":"2020-06-27T04:24:56.074612+0000","last_clean":"2020-06-27T04:24:56.074612+0000","last_became_active":"2020-06-27T04:24:56.074182+0000","last_became_peered":"2020-06-27T04:24:56.074182+0000","last_unstale":"2020-06-27T04:24:56.074612+0000","last_undegraded":"2020-06-27T04:24:56.074612+0000","last_fullsized":"2020-06-27T04:24:56.074612+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.076822+0000","last_change":"2020-06-27T04:24:56.076822+0000","last_active":"2020-06-27T04:24:56.076822+0000","last_peered":"2020-06-27T04:24:56.076822+0000","last_clean":"2020-06-27T04:24:56.076822+0000","last_became_active":"2020-06-27T04:24:56.076459+0000","last_became_peered":"2020-06-27T04:24:56.076459+0000","last_unstale":"2020-06-27T04:24:56.076822+0000","last_undegraded":"2020-06-27T04:24:56.076822+0000","last_fullsized":"2020-06-27T04:24:56.076822+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.077607+0000","last_change":"2020-06-27T04:24:56.077607+0000","last_active":"2020-06-27T04:24:56.077607+0000","last_peered":"2020-06-27T04:24:56.077607+0000","last_clean":"2020-06-27T04:24:56.077607+0000","last_became_active":"2020-06-27T04:24:56.077200+0000","last_became_peered":"2020-06-27T04:24:56.077200+0000","last_unstale":"2020-06-27T04:24:56.077607+0000","last_undegraded":"2020-06-27T04:24:56.077607+0000","last_fullsized":"2020-06-27T04:24:56.077607+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.079507+0000","last_change":"2020-06-27T04:24:56.078601+0000","last_active":"2020-06-27T04:24:56.079507+0000","last_peered":"2020-06-27T04:24:56.079507+0000","last_clean":"2020-06-27T04:24:56.079507+0000","last_became_active":"2020-06-27T04:24:56.078202+0000","last_became_peered":"2020-06-27T04:24:56.078202+0000","last_unstale":"2020-06-27T04:24:56.079507+0000","last_undegraded":"2020-06-27T04:24:56.079507+0000","last_fullsized":"2020-06-27T04:24:56.079507+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323160,"statfs":{"total":96636764160,"available":95562915840,"internally_reserved":1073741824,"allocated":98304,"data_stored":21587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323160,"statfs":{"total":96636764160,"available":95562915840,"internally_reserved":1073741824,"allocated":98304,"data_stored":21587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]}]}} 2020-06-27T04:25:00.531 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-27T04:25:00.805 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:25:00.807 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2020-06-27T04:25:00.816 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2020-06-27T04:24:59.025011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146048,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969472,"statfs":{"total":289910292480,"available":286688739328,"internally_reserved":3221225472,"allocated":303104,"data_stored":67454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.075413+0000","last_change":"2020-06-27T04:24:56.075413+0000","last_active":"2020-06-27T04:24:56.075413+0000","last_peered":"2020-06-27T04:24:56.075413+0000","last_clean":"2020-06-27T04:24:56.075413+0000","last_became_active":"2020-06-27T04:24:56.075003+0000","last_became_peered":"2020-06-27T04:24:56.075003+0000","last_unstale":"2020-06-27T04:24:56.075413+0000","last_undegraded":"2020-06-27T04:24:56.075413+0000","last_fullsized":"2020-06-27T04:24:56.075413+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.077641+0000","last_change":"2020-06-27T04:24:56.077641+0000","last_active":"2020-06-27T04:24:56.077641+0000","last_peered":"2020-06-27T04:24:56.077641+0000","last_clean":"2020-06-27T04:24:56.077641+0000","last_became_active":"2020-06-27T04:24:56.077234+0000","last_became_peered":"2020-06-27T04:24:56.077234+0000","last_unstale":"2020-06-27T04:24:56.077641+0000","last_undegraded":"2020-06-27T04:24:56.077641+0000","last_fullsized":"2020-06-27T04:24:56.077641+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.078132+0000","last_change":"2020-06-27T04:24:56.076999+0000","last_active":"2020-06-27T04:24:56.078132+0000","last_peered":"2020-06-27T04:24:56.078132+0000","last_clean":"2020-06-27T04:24:56.078132+0000","last_became_active":"2020-06-27T04:24:56.076651+0000","last_became_peered":"2020-06-27T04:24:56.076651+0000","last_unstale":"2020-06-27T04:24:56.078132+0000","last_undegraded":"2020-06-27T04:24:56.078132+0000","last_fullsized":"2020-06-27T04:24:56.078132+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.074118+0000","last_change":"2020-06-27T04:24:56.074118+0000","last_active":"2020-06-27T04:24:56.074118+0000","last_peered":"2020-06-27T04:24:56.074118+0000","last_clean":"2020-06-27T04:24:56.074118+0000","last_became_active":"2020-06-27T04:24:56.073721+0000","last_became_peered":"2020-06-27T04:24:56.073721+0000","last_unstale":"2020-06-27T04:24:56.074118+0000","last_undegraded":"2020-06-27T04:24:56.074118+0000","last_fullsized":"2020-06-27T04:24:56.074118+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.074612+0000","last_change":"2020-06-27T04:24:56.074612+0000","last_active":"2020-06-27T04:24:56.074612+0000","last_peered":"2020-06-27T04:24:56.074612+0000","last_clean":"2020-06-27T04:24:56.074612+0000","last_became_active":"2020-06-27T04:24:56.074182+0000","last_became_peered":"2020-06-27T04:24:56.074182+0000","last_unstale":"2020-06-27T04:24:56.074612+0000","last_undegraded":"2020-06-27T04:24:56.074612+0000","last_fullsized":"2020-06-27T04:24:56.074612+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.076822+0000","last_change":"2020-06-27T04:24:56.076822+0000","last_active":"2020-06-27T04:24:56.076822+0000","last_peered":"2020-06-27T04:24:56.076822+0000","last_clean":"2020-06-27T04:24:56.076822+0000","last_became_active":"2020-06-27T04:24:56.076459+0000","last_became_peered":"2020-06-27T04:24:56.076459+0000","last_unstale":"2020-06-27T04:24:56.076822+0000","last_undegraded":"2020-06-27T04:24:56.076822+0000","last_fullsized":"2020-06-27T04:24:56.076822+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.077607+0000","last_change":"2020-06-27T04:24:56.077607+0000","last_active":"2020-06-27T04:24:56.077607+0000","last_peered":"2020-06-27T04:24:56.077607+0000","last_clean":"2020-06-27T04:24:56.077607+0000","last_became_active":"2020-06-27T04:24:56.077200+0000","last_became_peered":"2020-06-27T04:24:56.077200+0000","last_unstale":"2020-06-27T04:24:56.077607+0000","last_undegraded":"2020-06-27T04:24:56.077607+0000","last_fullsized":"2020-06-27T04:24:56.077607+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.079507+0000","last_change":"2020-06-27T04:24:56.078601+0000","last_active":"2020-06-27T04:24:56.079507+0000","last_peered":"2020-06-27T04:24:56.079507+0000","last_clean":"2020-06-27T04:24:56.079507+0000","last_became_active":"2020-06-27T04:24:56.078202+0000","last_became_peered":"2020-06-27T04:24:56.078202+0000","last_unstale":"2020-06-27T04:24:56.079507+0000","last_undegraded":"2020-06-27T04:24:56.079507+0000","last_fullsized":"2020-06-27T04:24:56.079507+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323160,"statfs":{"total":96636764160,"available":95562915840,"internally_reserved":1073741824,"allocated":98304,"data_stored":21587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323160,"statfs":{"total":96636764160,"available":95562915840,"internally_reserved":1073741824,"allocated":98304,"data_stored":21587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]}]}} 2020-06-27T04:25:00.817 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-06-27T04:25:00.818 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-06-27T04:25:00.818 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-06-27T04:25:00.819 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-06-27T04:25:01.151 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:25:01.162 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-06-27T04:25:01.164 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-06-27T04:25:01.164 INFO:teuthology.run_tasks:Running task divergent_priors2... 2020-06-27T04:25:01.194 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump 2020-06-27T04:25:01.484 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 12 2020-06-27T04:25:01.484 INFO:teuthology.orchestra.run.smithi017.stdout:fsid a6b0e6f7-fcc2-46bd-b989-30e0231a9041 2020-06-27T04:25:01.484 INFO:teuthology.orchestra.run.smithi017.stdout:created 2020-06-27T04:24:45.487818+0000 2020-06-27T04:25:01.485 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2020-06-27T04:24:57.072684+0000 2020-06-27T04:25:01.485 INFO:teuthology.orchestra.run.smithi017.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2020-06-27T04:25:01.485 INFO:teuthology.orchestra.run.smithi017.stdout:crush_version 4 2020-06-27T04:25:01.485 INFO:teuthology.orchestra.run.smithi017.stdout:full_ratio 0.95 2020-06-27T04:25:01.485 INFO:teuthology.orchestra.run.smithi017.stdout:backfillfull_ratio 0.9 2020-06-27T04:25:01.486 INFO:teuthology.orchestra.run.smithi017.stdout:nearfull_ratio 0.85 2020-06-27T04:25:01.486 INFO:teuthology.orchestra.run.smithi017.stdout:require_min_compat_client luminous 2020-06-27T04:25:01.486 INFO:teuthology.orchestra.run.smithi017.stdout:min_compat_client jewel 2020-06-27T04:25:01.486 INFO:teuthology.orchestra.run.smithi017.stdout:require_osd_release pacific 2020-06-27T04:25:01.486 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 application rbd 2020-06-27T04:25:01.487 INFO:teuthology.orchestra.run.smithi017.stdout:max_osd 3 2020-06-27T04:25:01.487 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 up in weight 1 up_from 8 up_thru 10 down_at 0 last_clean_interval [0,0) v2:172.21.15.17:6800/20828 v2:172.21.15.17:6802/20828 exists,up 16e45fbd-d858-41fe-8a73-6f302f4fec59 2020-06-27T04:25:01.487 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 up in weight 1 up_from 8 up_thru 10 down_at 0 last_clean_interval [0,0) v2:172.21.15.17:6801/20827 v2:172.21.15.17:6803/20827 exists,up 17c4bc0d-e539-4f38-afb6-95e2448c5196 2020-06-27T04:25:01.487 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 up in weight 1 up_from 8 up_thru 10 down_at 0 last_clean_interval [0,0) v2:172.21.15.17:6808/20857 v2:172.21.15.17:6809/20857 exists,up 6c978f34-7b4f-4b96-8797-53ac8648d0d3 2020-06-27T04:25:01.495 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 10 down_at 0 last_clean_interval [0,0) v2:172.21.15.17:6800/20828 v2:172.21.15.17:6802/20828 exists,up 16e45fbd-d858-41fe-8a73-6f302f4fec59', 'osd.1 up in weight 1 up_from 8 up_thru 10 down_at 0 last_clean_interval [0,0) v2:172.21.15.17:6801/20827 v2:172.21.15.17:6803/20827 exists,up 17c4bc0d-e539-4f38-afb6-95e2448c5196', 'osd.2 up in weight 1 up_from 8 up_thru 10 down_at 0 last_clean_interval [0,0) v2:172.21.15.17:6808/20857 v2:172.21.15.17:6809/20857 exists,up 6c978f34-7b4f-4b96-8797-53ac8648d0d3'] 2020-06-27T04:25:01.496 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-06-27T04:25:01.645 INFO:teuthology.orchestra.run.smithi017.stdout:34359738373 2020-06-27T04:25:01.645 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-06-27T04:25:01.794 INFO:teuthology.orchestra.run.smithi017.stdout:34359738374 2020-06-27T04:25:01.795 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-06-27T04:25:01.943 INFO:teuthology.orchestra.run.smithi017.stdout:34359738374 2020-06-27T04:25:01.944 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-06-27T04:25:02.228 INFO:teuthology.orchestra.run.smithi017.stdout:34359738372 2020-06-27T04:25:02.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2020-06-27T04:25:03.241 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-06-27T04:25:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:34359738374 2020-06-27T04:25:03.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738374 for osd.0 2020-06-27T04:25:03.547 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-06-27T04:25:03.838 INFO:teuthology.orchestra.run.smithi017.stdout:34359738374 2020-06-27T04:25:03.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2020-06-27T04:25:03.840 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-06-27T04:25:04.120 INFO:teuthology.orchestra.run.smithi017.stdout:34359738374 2020-06-27T04:25:04.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.2 2020-06-27T04:25:04.133 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noout 2020-06-27T04:25:05.091 INFO:teuthology.orchestra.run.smithi017.stderr:noout is set 2020-06-27T04:25:05.104 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noin 2020-06-27T04:25:06.093 INFO:teuthology.orchestra.run.smithi017.stderr:noin is set 2020-06-27T04:25:06.111 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodown 2020-06-27T04:25:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:nodown is set 2020-06-27T04:25:07.114 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-06-27T04:25:07.115 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-27T04:25:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:25:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2020-06-27T04:25:07.406 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2020-06-27T04:25:07.096043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146064,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969456,"statfs":{"total":289910292480,"available":286688722944,"internally_reserved":3221225472,"allocated":319488,"data_stored":72840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.076563+0000","last_change":"2020-06-27T04:24:56.075413+0000","last_active":"2020-06-27T04:24:56.076563+0000","last_peered":"2020-06-27T04:24:56.076563+0000","last_clean":"2020-06-27T04:24:56.076563+0000","last_became_active":"2020-06-27T04:24:56.075003+0000","last_became_peered":"2020-06-27T04:24:56.075003+0000","last_unstale":"2020-06-27T04:24:56.076563+0000","last_undegraded":"2020-06-27T04:24:56.076563+0000","last_fullsized":"2020-06-27T04:24:56.076563+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.078244+0000","last_change":"2020-06-27T04:24:56.077641+0000","last_active":"2020-06-27T04:24:56.078244+0000","last_peered":"2020-06-27T04:24:56.078244+0000","last_clean":"2020-06-27T04:24:56.078244+0000","last_became_active":"2020-06-27T04:24:56.077234+0000","last_became_peered":"2020-06-27T04:24:56.077234+0000","last_unstale":"2020-06-27T04:24:56.078244+0000","last_undegraded":"2020-06-27T04:24:56.078244+0000","last_fullsized":"2020-06-27T04:24:56.078244+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.078132+0000","last_change":"2020-06-27T04:24:56.076999+0000","last_active":"2020-06-27T04:24:56.078132+0000","last_peered":"2020-06-27T04:24:56.078132+0000","last_clean":"2020-06-27T04:24:56.078132+0000","last_became_active":"2020-06-27T04:24:56.076651+0000","last_became_peered":"2020-06-27T04:24:56.076651+0000","last_unstale":"2020-06-27T04:24:56.078132+0000","last_undegraded":"2020-06-27T04:24:56.078132+0000","last_fullsized":"2020-06-27T04:24:56.078132+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.075213+0000","last_change":"2020-06-27T04:24:56.074118+0000","last_active":"2020-06-27T04:24:56.075213+0000","last_peered":"2020-06-27T04:24:56.075213+0000","last_clean":"2020-06-27T04:24:56.075213+0000","last_became_active":"2020-06-27T04:24:56.073721+0000","last_became_peered":"2020-06-27T04:24:56.073721+0000","last_unstale":"2020-06-27T04:24:56.075213+0000","last_undegraded":"2020-06-27T04:24:56.075213+0000","last_fullsized":"2020-06-27T04:24:56.075213+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.076415+0000","last_change":"2020-06-27T04:24:56.074612+0000","last_active":"2020-06-27T04:24:56.076415+0000","last_peered":"2020-06-27T04:24:56.076415+0000","last_clean":"2020-06-27T04:24:56.076415+0000","last_became_active":"2020-06-27T04:24:56.074182+0000","last_became_peered":"2020-06-27T04:24:56.074182+0000","last_unstale":"2020-06-27T04:24:56.076415+0000","last_undegraded":"2020-06-27T04:24:56.076415+0000","last_fullsized":"2020-06-27T04:24:56.076415+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.078179+0000","last_change":"2020-06-27T04:24:56.076822+0000","last_active":"2020-06-27T04:24:56.078179+0000","last_peered":"2020-06-27T04:24:56.078179+0000","last_clean":"2020-06-27T04:24:56.078179+0000","last_became_active":"2020-06-27T04:24:56.076459+0000","last_became_peered":"2020-06-27T04:24:56.076459+0000","last_unstale":"2020-06-27T04:24:56.078179+0000","last_undegraded":"2020-06-27T04:24:56.078179+0000","last_fullsized":"2020-06-27T04:24:56.078179+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.078215+0000","last_change":"2020-06-27T04:24:56.077607+0000","last_active":"2020-06-27T04:24:56.078215+0000","last_peered":"2020-06-27T04:24:56.078215+0000","last_clean":"2020-06-27T04:24:56.078215+0000","last_became_active":"2020-06-27T04:24:56.077200+0000","last_became_peered":"2020-06-27T04:24:56.077200+0000","last_unstale":"2020-06-27T04:24:56.078215+0000","last_undegraded":"2020-06-27T04:24:56.078215+0000","last_fullsized":"2020-06-27T04:24:56.078215+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.079507+0000","last_change":"2020-06-27T04:24:56.078601+0000","last_active":"2020-06-27T04:24:56.079507+0000","last_peered":"2020-06-27T04:24:56.079507+0000","last_clean":"2020-06-27T04:24:56.079507+0000","last_became_active":"2020-06-27T04:24:56.078202+0000","last_became_peered":"2020-06-27T04:24:56.078202+0000","last_unstale":"2020-06-27T04:24:56.079507+0000","last_undegraded":"2020-06-27T04:24:56.079507+0000","last_fullsized":"2020-06-27T04:24:56.079507+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]}]}} 2020-06-27T04:25:07.407 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-27T04:25:07.685 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:25:07.686 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2020-06-27T04:25:07.696 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2020-06-27T04:25:07.096043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146064,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969456,"statfs":{"total":289910292480,"available":286688722944,"internally_reserved":3221225472,"allocated":319488,"data_stored":72840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.076563+0000","last_change":"2020-06-27T04:24:56.075413+0000","last_active":"2020-06-27T04:24:56.076563+0000","last_peered":"2020-06-27T04:24:56.076563+0000","last_clean":"2020-06-27T04:24:56.076563+0000","last_became_active":"2020-06-27T04:24:56.075003+0000","last_became_peered":"2020-06-27T04:24:56.075003+0000","last_unstale":"2020-06-27T04:24:56.076563+0000","last_undegraded":"2020-06-27T04:24:56.076563+0000","last_fullsized":"2020-06-27T04:24:56.076563+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.078244+0000","last_change":"2020-06-27T04:24:56.077641+0000","last_active":"2020-06-27T04:24:56.078244+0000","last_peered":"2020-06-27T04:24:56.078244+0000","last_clean":"2020-06-27T04:24:56.078244+0000","last_became_active":"2020-06-27T04:24:56.077234+0000","last_became_peered":"2020-06-27T04:24:56.077234+0000","last_unstale":"2020-06-27T04:24:56.078244+0000","last_undegraded":"2020-06-27T04:24:56.078244+0000","last_fullsized":"2020-06-27T04:24:56.078244+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.078132+0000","last_change":"2020-06-27T04:24:56.076999+0000","last_active":"2020-06-27T04:24:56.078132+0000","last_peered":"2020-06-27T04:24:56.078132+0000","last_clean":"2020-06-27T04:24:56.078132+0000","last_became_active":"2020-06-27T04:24:56.076651+0000","last_became_peered":"2020-06-27T04:24:56.076651+0000","last_unstale":"2020-06-27T04:24:56.078132+0000","last_undegraded":"2020-06-27T04:24:56.078132+0000","last_fullsized":"2020-06-27T04:24:56.078132+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.075213+0000","last_change":"2020-06-27T04:24:56.074118+0000","last_active":"2020-06-27T04:24:56.075213+0000","last_peered":"2020-06-27T04:24:56.075213+0000","last_clean":"2020-06-27T04:24:56.075213+0000","last_became_active":"2020-06-27T04:24:56.073721+0000","last_became_peered":"2020-06-27T04:24:56.073721+0000","last_unstale":"2020-06-27T04:24:56.075213+0000","last_undegraded":"2020-06-27T04:24:56.075213+0000","last_fullsized":"2020-06-27T04:24:56.075213+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.076415+0000","last_change":"2020-06-27T04:24:56.074612+0000","last_active":"2020-06-27T04:24:56.076415+0000","last_peered":"2020-06-27T04:24:56.076415+0000","last_clean":"2020-06-27T04:24:56.076415+0000","last_became_active":"2020-06-27T04:24:56.074182+0000","last_became_peered":"2020-06-27T04:24:56.074182+0000","last_unstale":"2020-06-27T04:24:56.076415+0000","last_undegraded":"2020-06-27T04:24:56.076415+0000","last_fullsized":"2020-06-27T04:24:56.076415+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.078179+0000","last_change":"2020-06-27T04:24:56.076822+0000","last_active":"2020-06-27T04:24:56.078179+0000","last_peered":"2020-06-27T04:24:56.078179+0000","last_clean":"2020-06-27T04:24:56.078179+0000","last_became_active":"2020-06-27T04:24:56.076459+0000","last_became_peered":"2020-06-27T04:24:56.076459+0000","last_unstale":"2020-06-27T04:24:56.078179+0000","last_undegraded":"2020-06-27T04:24:56.078179+0000","last_fullsized":"2020-06-27T04:24:56.078179+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.078215+0000","last_change":"2020-06-27T04:24:56.077607+0000","last_active":"2020-06-27T04:24:56.078215+0000","last_peered":"2020-06-27T04:24:56.078215+0000","last_clean":"2020-06-27T04:24:56.078215+0000","last_became_active":"2020-06-27T04:24:56.077200+0000","last_became_peered":"2020-06-27T04:24:56.077200+0000","last_unstale":"2020-06-27T04:24:56.078215+0000","last_undegraded":"2020-06-27T04:24:56.078215+0000","last_fullsized":"2020-06-27T04:24:56.078215+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2020-06-27T04:24:56.079507+0000","last_change":"2020-06-27T04:24:56.078601+0000","last_active":"2020-06-27T04:24:56.079507+0000","last_peered":"2020-06-27T04:24:56.079507+0000","last_clean":"2020-06-27T04:24:56.079507+0000","last_became_active":"2020-06-27T04:24:56.078202+0000","last_became_peered":"2020-06-27T04:24:56.078202+0000","last_unstale":"2020-06-27T04:24:56.079507+0000","last_undegraded":"2020-06-27T04:24:56.079507+0000","last_fullsized":"2020-06-27T04:24:56.079507+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]}]}} 2020-06-27T04:25:07.698 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-06-27T04:25:07.699 INFO:tasks.divergent_priors2:creating foo 2020-06-27T04:25:07.699 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create foo 1 2020-06-27T04:25:08.109 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'foo' created 2020-06-27T04:25:08.124 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set osd_min_pg_log_entries 10 2020-06-27T04:25:08.258 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:08.259 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_min_pg_log_entries = '10' (not observed, change may require restart) " 2020-06-27T04:25:08.259 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:08.267 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set osd_max_pg_log_entries 10 2020-06-27T04:25:08.396 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:08.396 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_max_pg_log_entries = '10' (not observed, change may require restart) " 2020-06-27T04:25:08.396 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:08.405 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set osd_pg_log_trim_min 5 2020-06-27T04:25:08.533 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:08.533 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_pg_log_trim_min = '5' (not observed, change may require restart) " 2020-06-27T04:25:08.533 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:08.537 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set osd_min_pg_log_entries 10 2020-06-27T04:25:08.662 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:08.663 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_min_pg_log_entries = '10' (not observed, change may require restart) " 2020-06-27T04:25:08.663 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:08.671 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set osd_max_pg_log_entries 10 2020-06-27T04:25:08.796 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:08.796 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_max_pg_log_entries = '10' (not observed, change may require restart) " 2020-06-27T04:25:08.796 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:08.805 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set osd_pg_log_trim_min 5 2020-06-27T04:25:08.929 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:08.929 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_pg_log_trim_min = '5' (not observed, change may require restart) " 2020-06-27T04:25:08.929 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:08.940 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set osd_min_pg_log_entries 10 2020-06-27T04:25:09.064 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:09.064 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_min_pg_log_entries = '10' (not observed, change may require restart) " 2020-06-27T04:25:09.064 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:09.073 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set osd_max_pg_log_entries 10 2020-06-27T04:25:09.198 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:09.198 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_max_pg_log_entries = '10' (not observed, change may require restart) " 2020-06-27T04:25:09.199 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:09.207 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set osd_pg_log_trim_min 5 2020-06-27T04:25:09.330 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:09.331 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_pg_log_trim_min = '5' (not observed, change may require restart) " 2020-06-27T04:25:09.331 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:09.339 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-27T04:25:09.619 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:25:09.619 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"fsid":"a6b0e6f7-fcc2-46bd-b989-30e0231a9041","created":"2020-06-27T04:24:45.487818+0000","modified":"2020-06-27T04:25:09.101679+0000","last_up_change":"2020-06-27T04:24:52.047186+0000","last_in_change":"2020-06-27T04:24:52.047186+0000","flags":"nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800384,"flags_set":["nodown","noin","noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-06-27T04:24:54.904562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"foo","create_time":"2020-06-27T04:25:08.023050+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"16e45fbd-d858-41fe-8a73-6f302f4fec59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":20828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":20828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":20828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":20828}]},"public_addr":"172.21.15.17:6800/20828","cluster_addr":"172.21.15.17:6802/20828","heartbeat_back_addr":"172.21.15.17:6806/20828","heartbeat_front_addr":"172.21.15.17:6804/20828","state":["exists","up"]},{"osd":1,"uuid":"17c4bc0d-e539-4f38-afb6-95e2448c5196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6801","nonce":20827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6803","nonce":20827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6807","nonce":20827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6805","nonce":20827}]},"public_addr":"172.21.15.17:6801/20827","cluster_addr":"172.21.15.17:6803/20827","heartbeat_back_addr":"172.21.15.17:6807/20827","heartbeat_front_addr":"172.21.15.17:6805/20827","state":["exists","up"]},{"osd":2,"uuid":"6c978f34-7b4f-4b96-8797-53ac8648d0d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":20857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":20857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6811","nonce":20857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":20857}]},"public_addr":"172.21.15.17:6808/20857","cluster_addr":"172.21.15.17:6809/20857","heartbeat_back_addr":"172.21.15.17:6811/20857","heartbeat_front_addr":"172.21.15.17:6810/20857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.168668+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.120691+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-06-27T04:24:50.201967+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-27T04:25:09.631 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg map 2.0 --format=json 2020-06-27T04:25:09.907 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:25:09.919 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"raw_pgid":"2.0","pgid":"2.0","up":[2,1],"acting":[2,1]} 2020-06-27T04:25:09.920 INFO:tasks.divergent_priors2:primary and soon to be divergent is 2 2020-06-27T04:25:09.921 INFO:tasks.divergent_priors2:writing initial objects 2020-06-27T04:25:09.921 INFO:tasks.util.rados:rados -p foo put existing_0 /etc/fstab 2020-06-27T04:25:09.922 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_0 /etc/fstab 2020-06-27T04:25:09.966 INFO:tasks.util.rados:rados -p foo put existing_1 /etc/fstab 2020-06-27T04:25:09.966 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_1 /etc/fstab 2020-06-27T04:25:10.050 INFO:tasks.util.rados:rados -p foo put existing_2 /etc/fstab 2020-06-27T04:25:10.050 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_2 /etc/fstab 2020-06-27T04:25:10.135 INFO:tasks.util.rados:rados -p foo put existing_3 /etc/fstab 2020-06-27T04:25:10.135 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_3 /etc/fstab 2020-06-27T04:25:10.224 INFO:tasks.util.rados:rados -p foo put existing_4 /etc/fstab 2020-06-27T04:25:10.224 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_4 /etc/fstab 2020-06-27T04:25:10.278 INFO:tasks.util.rados:rados -p foo put existing_5 /etc/fstab 2020-06-27T04:25:10.279 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_5 /etc/fstab 2020-06-27T04:25:10.362 INFO:tasks.util.rados:rados -p foo put existing_6 /etc/fstab 2020-06-27T04:25:10.362 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_6 /etc/fstab 2020-06-27T04:25:10.446 INFO:tasks.util.rados:rados -p foo put existing_7 /etc/fstab 2020-06-27T04:25:10.446 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_7 /etc/fstab 2020-06-27T04:25:10.532 INFO:tasks.util.rados:rados -p foo put existing_8 /etc/fstab 2020-06-27T04:25:10.533 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_8 /etc/fstab 2020-06-27T04:25:10.577 INFO:tasks.util.rados:rados -p foo put existing_9 /etc/fstab 2020-06-27T04:25:10.577 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_9 /etc/fstab 2020-06-27T04:25:10.661 INFO:tasks.util.rados:rados -p foo put existing_10 /etc/fstab 2020-06-27T04:25:10.661 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_10 /etc/fstab 2020-06-27T04:25:10.744 INFO:tasks.util.rados:rados -p foo put existing_11 /etc/fstab 2020-06-27T04:25:10.745 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_11 /etc/fstab 2020-06-27T04:25:10.828 INFO:tasks.util.rados:rados -p foo put existing_12 /etc/fstab 2020-06-27T04:25:10.829 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_12 /etc/fstab 2020-06-27T04:25:10.913 INFO:tasks.util.rados:rados -p foo put existing_13 /etc/fstab 2020-06-27T04:25:10.914 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_13 /etc/fstab 2020-06-27T04:25:10.998 INFO:tasks.util.rados:rados -p foo put existing_14 /etc/fstab 2020-06-27T04:25:10.999 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_14 /etc/fstab 2020-06-27T04:25:11.049 INFO:tasks.util.rados:rados -p foo put existing_15 /etc/fstab 2020-06-27T04:25:11.050 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_15 /etc/fstab 2020-06-27T04:25:11.097 INFO:tasks.util.rados:rados -p foo put existing_16 /etc/fstab 2020-06-27T04:25:11.098 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_16 /etc/fstab 2020-06-27T04:25:11.141 INFO:tasks.util.rados:rados -p foo put existing_17 /etc/fstab 2020-06-27T04:25:11.142 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_17 /etc/fstab 2020-06-27T04:25:11.226 INFO:tasks.util.rados:rados -p foo put existing_18 /etc/fstab 2020-06-27T04:25:11.227 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_18 /etc/fstab 2020-06-27T04:25:11.310 INFO:tasks.util.rados:rados -p foo put existing_19 /etc/fstab 2020-06-27T04:25:11.311 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_19 /etc/fstab 2020-06-27T04:25:11.396 INFO:tasks.util.rados:rados -p foo put existing_20 /etc/fstab 2020-06-27T04:25:11.396 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_20 /etc/fstab 2020-06-27T04:25:11.482 INFO:tasks.util.rados:rados -p foo put existing_21 /etc/fstab 2020-06-27T04:25:11.483 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_21 /etc/fstab 2020-06-27T04:25:11.531 INFO:tasks.util.rados:rados -p foo put existing_22 /etc/fstab 2020-06-27T04:25:11.532 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_22 /etc/fstab 2020-06-27T04:25:11.617 INFO:tasks.util.rados:rados -p foo put existing_23 /etc/fstab 2020-06-27T04:25:11.618 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_23 /etc/fstab 2020-06-27T04:25:11.662 INFO:tasks.util.rados:rados -p foo put existing_24 /etc/fstab 2020-06-27T04:25:11.663 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_24 /etc/fstab 2020-06-27T04:25:11.747 INFO:tasks.util.rados:rados -p foo put existing_25 /etc/fstab 2020-06-27T04:25:11.747 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_25 /etc/fstab 2020-06-27T04:25:11.831 INFO:tasks.util.rados:rados -p foo put existing_26 /etc/fstab 2020-06-27T04:25:11.833 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_26 /etc/fstab 2020-06-27T04:25:11.914 INFO:tasks.util.rados:rados -p foo put existing_27 /etc/fstab 2020-06-27T04:25:11.915 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_27 /etc/fstab 2020-06-27T04:25:11.998 INFO:tasks.util.rados:rados -p foo put existing_28 /etc/fstab 2020-06-27T04:25:11.999 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_28 /etc/fstab 2020-06-27T04:25:12.083 INFO:tasks.util.rados:rados -p foo put existing_29 /etc/fstab 2020-06-27T04:25:12.084 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_29 /etc/fstab 2020-06-27T04:25:12.167 INFO:tasks.util.rados:rados -p foo put existing_30 /etc/fstab 2020-06-27T04:25:12.167 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_30 /etc/fstab 2020-06-27T04:25:12.253 INFO:tasks.util.rados:rados -p foo put existing_31 /etc/fstab 2020-06-27T04:25:12.254 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_31 /etc/fstab 2020-06-27T04:25:12.336 INFO:tasks.util.rados:rados -p foo put existing_32 /etc/fstab 2020-06-27T04:25:12.337 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_32 /etc/fstab 2020-06-27T04:25:12.420 INFO:tasks.util.rados:rados -p foo put existing_33 /etc/fstab 2020-06-27T04:25:12.421 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_33 /etc/fstab 2020-06-27T04:25:12.503 INFO:tasks.util.rados:rados -p foo put existing_34 /etc/fstab 2020-06-27T04:25:12.504 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_34 /etc/fstab 2020-06-27T04:25:12.587 INFO:tasks.util.rados:rados -p foo put existing_35 /etc/fstab 2020-06-27T04:25:12.587 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_35 /etc/fstab 2020-06-27T04:25:12.670 INFO:tasks.util.rados:rados -p foo put existing_36 /etc/fstab 2020-06-27T04:25:12.671 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_36 /etc/fstab 2020-06-27T04:25:12.754 INFO:tasks.util.rados:rados -p foo put existing_37 /etc/fstab 2020-06-27T04:25:12.755 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_37 /etc/fstab 2020-06-27T04:25:12.856 INFO:tasks.util.rados:rados -p foo put existing_38 /etc/fstab 2020-06-27T04:25:12.857 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_38 /etc/fstab 2020-06-27T04:25:12.939 INFO:tasks.util.rados:rados -p foo put existing_39 /etc/fstab 2020-06-27T04:25:12.940 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_39 /etc/fstab 2020-06-27T04:25:13.025 INFO:tasks.util.rados:rados -p foo put existing_40 /etc/fstab 2020-06-27T04:25:13.026 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_40 /etc/fstab 2020-06-27T04:25:13.110 INFO:tasks.util.rados:rados -p foo put existing_41 /etc/fstab 2020-06-27T04:25:13.110 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_41 /etc/fstab 2020-06-27T04:25:13.154 INFO:tasks.util.rados:rados -p foo put existing_42 /etc/fstab 2020-06-27T04:25:13.154 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_42 /etc/fstab 2020-06-27T04:25:13.243 INFO:tasks.util.rados:rados -p foo put existing_43 /etc/fstab 2020-06-27T04:25:13.244 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_43 /etc/fstab 2020-06-27T04:25:13.326 INFO:tasks.util.rados:rados -p foo put existing_44 /etc/fstab 2020-06-27T04:25:13.327 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_44 /etc/fstab 2020-06-27T04:25:13.410 INFO:tasks.util.rados:rados -p foo put existing_45 /etc/fstab 2020-06-27T04:25:13.411 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_45 /etc/fstab 2020-06-27T04:25:13.495 INFO:tasks.util.rados:rados -p foo put existing_46 /etc/fstab 2020-06-27T04:25:13.496 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_46 /etc/fstab 2020-06-27T04:25:13.578 INFO:tasks.util.rados:rados -p foo put existing_47 /etc/fstab 2020-06-27T04:25:13.579 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_47 /etc/fstab 2020-06-27T04:25:13.667 INFO:tasks.util.rados:rados -p foo put existing_48 /etc/fstab 2020-06-27T04:25:13.668 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_48 /etc/fstab 2020-06-27T04:25:13.711 INFO:tasks.util.rados:rados -p foo put existing_49 /etc/fstab 2020-06-27T04:25:13.712 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_49 /etc/fstab 2020-06-27T04:25:13.795 INFO:tasks.util.rados:rados -p foo put existing_50 /etc/fstab 2020-06-27T04:25:13.795 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_50 /etc/fstab 2020-06-27T04:25:13.878 INFO:tasks.util.rados:rados -p foo put existing_51 /etc/fstab 2020-06-27T04:25:13.879 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_51 /etc/fstab 2020-06-27T04:25:13.963 INFO:tasks.util.rados:rados -p foo put existing_52 /etc/fstab 2020-06-27T04:25:13.963 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_52 /etc/fstab 2020-06-27T04:25:14.047 INFO:tasks.util.rados:rados -p foo put existing_53 /etc/fstab 2020-06-27T04:25:14.047 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_53 /etc/fstab 2020-06-27T04:25:14.147 INFO:tasks.util.rados:rados -p foo put existing_54 /etc/fstab 2020-06-27T04:25:14.148 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_54 /etc/fstab 2020-06-27T04:25:14.236 INFO:tasks.util.rados:rados -p foo put existing_55 /etc/fstab 2020-06-27T04:25:14.237 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_55 /etc/fstab 2020-06-27T04:25:14.319 INFO:tasks.util.rados:rados -p foo put existing_56 /etc/fstab 2020-06-27T04:25:14.320 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_56 /etc/fstab 2020-06-27T04:25:14.403 INFO:tasks.util.rados:rados -p foo put existing_57 /etc/fstab 2020-06-27T04:25:14.403 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_57 /etc/fstab 2020-06-27T04:25:14.486 INFO:tasks.util.rados:rados -p foo put existing_58 /etc/fstab 2020-06-27T04:25:14.487 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_58 /etc/fstab 2020-06-27T04:25:14.569 INFO:tasks.util.rados:rados -p foo put existing_59 /etc/fstab 2020-06-27T04:25:14.570 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_59 /etc/fstab 2020-06-27T04:25:14.654 INFO:tasks.util.rados:rados -p foo put existing_60 /etc/fstab 2020-06-27T04:25:14.654 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_60 /etc/fstab 2020-06-27T04:25:14.738 INFO:tasks.util.rados:rados -p foo put existing_61 /etc/fstab 2020-06-27T04:25:14.739 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_61 /etc/fstab 2020-06-27T04:25:14.822 INFO:tasks.util.rados:rados -p foo put existing_62 /etc/fstab 2020-06-27T04:25:14.823 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_62 /etc/fstab 2020-06-27T04:25:14.905 INFO:tasks.util.rados:rados -p foo put existing_63 /etc/fstab 2020-06-27T04:25:14.906 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_63 /etc/fstab 2020-06-27T04:25:14.988 INFO:tasks.util.rados:rados -p foo put existing_64 /etc/fstab 2020-06-27T04:25:14.989 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_64 /etc/fstab 2020-06-27T04:25:15.074 INFO:tasks.util.rados:rados -p foo put existing_65 /etc/fstab 2020-06-27T04:25:15.075 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_65 /etc/fstab 2020-06-27T04:25:15.158 INFO:tasks.util.rados:rados -p foo put existing_66 /etc/fstab 2020-06-27T04:25:15.158 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_66 /etc/fstab 2020-06-27T04:25:15.242 INFO:tasks.util.rados:rados -p foo put existing_67 /etc/fstab 2020-06-27T04:25:15.243 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_67 /etc/fstab 2020-06-27T04:25:15.286 INFO:tasks.util.rados:rados -p foo put existing_68 /etc/fstab 2020-06-27T04:25:15.291 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_68 /etc/fstab 2020-06-27T04:25:15.370 INFO:tasks.util.rados:rados -p foo put existing_69 /etc/fstab 2020-06-27T04:25:15.371 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_69 /etc/fstab 2020-06-27T04:25:15.454 INFO:tasks.util.rados:rados -p foo put existing_70 /etc/fstab 2020-06-27T04:25:15.455 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_70 /etc/fstab 2020-06-27T04:25:15.538 INFO:tasks.util.rados:rados -p foo put existing_71 /etc/fstab 2020-06-27T04:25:15.539 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_71 /etc/fstab 2020-06-27T04:25:15.621 INFO:tasks.util.rados:rados -p foo put existing_72 /etc/fstab 2020-06-27T04:25:15.622 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_72 /etc/fstab 2020-06-27T04:25:15.707 INFO:tasks.util.rados:rados -p foo put existing_73 /etc/fstab 2020-06-27T04:25:15.708 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_73 /etc/fstab 2020-06-27T04:25:15.791 INFO:tasks.util.rados:rados -p foo put existing_74 /etc/fstab 2020-06-27T04:25:15.792 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_74 /etc/fstab 2020-06-27T04:25:15.874 INFO:tasks.util.rados:rados -p foo put existing_75 /etc/fstab 2020-06-27T04:25:15.875 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_75 /etc/fstab 2020-06-27T04:25:15.958 INFO:tasks.util.rados:rados -p foo put existing_76 /etc/fstab 2020-06-27T04:25:15.959 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_76 /etc/fstab 2020-06-27T04:25:16.041 INFO:tasks.util.rados:rados -p foo put existing_77 /etc/fstab 2020-06-27T04:25:16.042 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_77 /etc/fstab 2020-06-27T04:25:16.124 INFO:tasks.util.rados:rados -p foo put existing_78 /etc/fstab 2020-06-27T04:25:16.125 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_78 /etc/fstab 2020-06-27T04:25:16.210 INFO:tasks.util.rados:rados -p foo put existing_79 /etc/fstab 2020-06-27T04:25:16.210 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_79 /etc/fstab 2020-06-27T04:25:16.293 INFO:tasks.util.rados:rados -p foo put existing_80 /etc/fstab 2020-06-27T04:25:16.294 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_80 /etc/fstab 2020-06-27T04:25:16.377 INFO:tasks.util.rados:rados -p foo put existing_81 /etc/fstab 2020-06-27T04:25:16.377 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_81 /etc/fstab 2020-06-27T04:25:16.460 INFO:tasks.util.rados:rados -p foo put existing_82 /etc/fstab 2020-06-27T04:25:16.461 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_82 /etc/fstab 2020-06-27T04:25:16.557 INFO:tasks.util.rados:rados -p foo put existing_83 /etc/fstab 2020-06-27T04:25:16.558 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_83 /etc/fstab 2020-06-27T04:25:16.629 INFO:tasks.util.rados:rados -p foo put existing_84 /etc/fstab 2020-06-27T04:25:16.629 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_84 /etc/fstab 2020-06-27T04:25:16.712 INFO:tasks.util.rados:rados -p foo put existing_85 /etc/fstab 2020-06-27T04:25:16.713 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_85 /etc/fstab 2020-06-27T04:25:16.795 INFO:tasks.util.rados:rados -p foo put existing_86 /etc/fstab 2020-06-27T04:25:16.796 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_86 /etc/fstab 2020-06-27T04:25:16.879 INFO:tasks.util.rados:rados -p foo put existing_87 /etc/fstab 2020-06-27T04:25:16.880 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_87 /etc/fstab 2020-06-27T04:25:16.923 INFO:tasks.util.rados:rados -p foo put existing_88 /etc/fstab 2020-06-27T04:25:16.924 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_88 /etc/fstab 2020-06-27T04:25:17.006 INFO:tasks.util.rados:rados -p foo put existing_89 /etc/fstab 2020-06-27T04:25:17.007 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_89 /etc/fstab 2020-06-27T04:25:17.092 INFO:tasks.util.rados:rados -p foo put existing_90 /etc/fstab 2020-06-27T04:25:17.092 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_90 /etc/fstab 2020-06-27T04:25:17.137 INFO:tasks.util.rados:rados -p foo put existing_91 /etc/fstab 2020-06-27T04:25:17.137 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_91 /etc/fstab 2020-06-27T04:25:17.220 INFO:tasks.util.rados:rados -p foo put existing_92 /etc/fstab 2020-06-27T04:25:17.221 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_92 /etc/fstab 2020-06-27T04:25:17.304 INFO:tasks.util.rados:rados -p foo put existing_93 /etc/fstab 2020-06-27T04:25:17.304 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_93 /etc/fstab 2020-06-27T04:25:17.387 INFO:tasks.util.rados:rados -p foo put existing_94 /etc/fstab 2020-06-27T04:25:17.388 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_94 /etc/fstab 2020-06-27T04:25:17.471 INFO:tasks.util.rados:rados -p foo put existing_95 /etc/fstab 2020-06-27T04:25:17.472 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_95 /etc/fstab 2020-06-27T04:25:17.562 INFO:tasks.util.rados:rados -p foo put existing_96 /etc/fstab 2020-06-27T04:25:17.562 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_96 /etc/fstab 2020-06-27T04:25:17.645 INFO:tasks.util.rados:rados -p foo put existing_97 /etc/fstab 2020-06-27T04:25:17.646 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_97 /etc/fstab 2020-06-27T04:25:17.729 INFO:tasks.util.rados:rados -p foo put existing_98 /etc/fstab 2020-06-27T04:25:17.730 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_98 /etc/fstab 2020-06-27T04:25:17.815 INFO:tasks.util.rados:rados -p foo put existing_99 /etc/fstab 2020-06-27T04:25:17.816 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_99 /etc/fstab 2020-06-27T04:25:17.898 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-06-27T04:25:17.899 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-27T04:25:18.214 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:25:18.215 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2020-06-27T04:25:18.225 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2020-06-27T04:25:17.028249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19320,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146500,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969020,"statfs":{"total":289910292480,"available":286688276480,"internally_reserved":3221225472,"allocated":765952,"data_stored":155658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000340"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.106515+0000","last_change":"2020-06-27T04:24:56.075413+0000","last_active":"2020-06-27T04:25:09.106515+0000","last_peered":"2020-06-27T04:25:09.106515+0000","last_clean":"2020-06-27T04:25:09.106515+0000","last_became_active":"2020-06-27T04:24:56.075003+0000","last_became_peered":"2020-06-27T04:24:56.075003+0000","last_unstale":"2020-06-27T04:25:09.106515+0000","last_undegraded":"2020-06-27T04:25:09.106515+0000","last_fullsized":"2020-06-27T04:25:09.106515+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.106250+0000","last_change":"2020-06-27T04:24:56.077641+0000","last_active":"2020-06-27T04:25:09.106250+0000","last_peered":"2020-06-27T04:25:09.106250+0000","last_clean":"2020-06-27T04:25:09.106250+0000","last_became_active":"2020-06-27T04:24:56.077234+0000","last_became_peered":"2020-06-27T04:24:56.077234+0000","last_unstale":"2020-06-27T04:25:09.106250+0000","last_undegraded":"2020-06-27T04:25:09.106250+0000","last_fullsized":"2020-06-27T04:25:09.106250+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.107333+0000","last_change":"2020-06-27T04:24:56.076999+0000","last_active":"2020-06-27T04:25:09.107333+0000","last_peered":"2020-06-27T04:25:09.107333+0000","last_clean":"2020-06-27T04:25:09.107333+0000","last_became_active":"2020-06-27T04:24:56.076651+0000","last_became_peered":"2020-06-27T04:24:56.076651+0000","last_unstale":"2020-06-27T04:25:09.107333+0000","last_undegraded":"2020-06-27T04:25:09.107333+0000","last_fullsized":"2020-06-27T04:25:09.107333+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.106235+0000","last_change":"2020-06-27T04:24:56.074118+0000","last_active":"2020-06-27T04:25:09.106235+0000","last_peered":"2020-06-27T04:25:09.106235+0000","last_clean":"2020-06-27T04:25:09.106235+0000","last_became_active":"2020-06-27T04:24:56.073721+0000","last_became_peered":"2020-06-27T04:24:56.073721+0000","last_unstale":"2020-06-27T04:25:09.106235+0000","last_undegraded":"2020-06-27T04:25:09.106235+0000","last_fullsized":"2020-06-27T04:25:09.106235+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.865794+0000","last_change":"2020-06-27T04:24:56.074612+0000","last_active":"2020-06-27T04:25:09.865794+0000","last_peered":"2020-06-27T04:25:09.865794+0000","last_clean":"2020-06-27T04:25:09.865794+0000","last_became_active":"2020-06-27T04:24:56.074182+0000","last_became_peered":"2020-06-27T04:24:56.074182+0000","last_unstale":"2020-06-27T04:25:09.865794+0000","last_undegraded":"2020-06-27T04:25:09.865794+0000","last_fullsized":"2020-06-27T04:25:09.865794+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'40","reported_seq":"49","reported_epoch":"18","state":"active+clean","last_fresh":"2020-06-27T04:25:12.935674+0000","last_change":"2020-06-27T04:25:09.109394+0000","last_active":"2020-06-27T04:25:12.935674+0000","last_peered":"2020-06-27T04:25:12.935674+0000","last_clean":"2020-06-27T04:25:12.935674+0000","last_became_active":"2020-06-27T04:25:09.109008+0000","last_became_peered":"2020-06-27T04:25:09.109008+0000","last_unstale":"2020-06-27T04:25:12.935674+0000","last_undegraded":"2020-06-27T04:25:12.935674+0000","last_fullsized":"2020-06-27T04:25:12.935674+0000","mapping_epoch":16,"log_start":"18'25","ondisk_log_start":"18'25","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:25:08.095579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:25:08.095579+0000","last_clean_scrub_stamp":"2020-06-27T04:25:08.095579+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19320,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.106312+0000","last_change":"2020-06-27T04:24:56.076822+0000","last_active":"2020-06-27T04:25:09.106312+0000","last_peered":"2020-06-27T04:25:09.106312+0000","last_clean":"2020-06-27T04:25:09.106312+0000","last_became_active":"2020-06-27T04:24:56.076459+0000","last_became_peered":"2020-06-27T04:24:56.076459+0000","last_unstale":"2020-06-27T04:25:09.106312+0000","last_undegraded":"2020-06-27T04:25:09.106312+0000","last_fullsized":"2020-06-27T04:25:09.106312+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.106432+0000","last_change":"2020-06-27T04:24:56.077607+0000","last_active":"2020-06-27T04:25:09.106432+0000","last_peered":"2020-06-27T04:25:09.106432+0000","last_clean":"2020-06-27T04:25:09.106432+0000","last_became_active":"2020-06-27T04:24:56.077200+0000","last_became_peered":"2020-06-27T04:24:56.077200+0000","last_unstale":"2020-06-27T04:25:09.106432+0000","last_undegraded":"2020-06-27T04:25:09.106432+0000","last_fullsized":"2020-06-27T04:25:09.106432+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.107375+0000","last_change":"2020-06-27T04:24:56.078601+0000","last_active":"2020-06-27T04:25:09.107375+0000","last_peered":"2020-06-27T04:25:09.107375+0000","last_clean":"2020-06-27T04:25:09.107375+0000","last_became_active":"2020-06-27T04:24:56.078202+0000","last_became_peered":"2020-06-27T04:24:56.078202+0000","last_unstale":"2020-06-27T04:25:09.107375+0000","last_undegraded":"2020-06-27T04:25:09.107375+0000","last_fullsized":"2020-06-27T04:25:09.107375+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":19320,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":44919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048908,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322932,"statfs":{"total":96636764160,"available":95562682368,"internally_reserved":1073741824,"allocated":331776,"data_stored":60902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":40133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":54623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]}]}} 2020-06-27T04:25:18.227 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-27T04:25:18.500 INFO:teuthology.orchestra.run.smithi017.stdout: 2020-06-27T04:25:18.502 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2020-06-27T04:25:18.512 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2020-06-27T04:25:17.028249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19320,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146500,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969020,"statfs":{"total":289910292480,"available":286688276480,"internally_reserved":3221225472,"allocated":765952,"data_stored":155658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000340"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.106515+0000","last_change":"2020-06-27T04:24:56.075413+0000","last_active":"2020-06-27T04:25:09.106515+0000","last_peered":"2020-06-27T04:25:09.106515+0000","last_clean":"2020-06-27T04:25:09.106515+0000","last_became_active":"2020-06-27T04:24:56.075003+0000","last_became_peered":"2020-06-27T04:24:56.075003+0000","last_unstale":"2020-06-27T04:25:09.106515+0000","last_undegraded":"2020-06-27T04:25:09.106515+0000","last_fullsized":"2020-06-27T04:25:09.106515+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.106250+0000","last_change":"2020-06-27T04:24:56.077641+0000","last_active":"2020-06-27T04:25:09.106250+0000","last_peered":"2020-06-27T04:25:09.106250+0000","last_clean":"2020-06-27T04:25:09.106250+0000","last_became_active":"2020-06-27T04:24:56.077234+0000","last_became_peered":"2020-06-27T04:24:56.077234+0000","last_unstale":"2020-06-27T04:25:09.106250+0000","last_undegraded":"2020-06-27T04:25:09.106250+0000","last_fullsized":"2020-06-27T04:25:09.106250+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.107333+0000","last_change":"2020-06-27T04:24:56.076999+0000","last_active":"2020-06-27T04:25:09.107333+0000","last_peered":"2020-06-27T04:25:09.107333+0000","last_clean":"2020-06-27T04:25:09.107333+0000","last_became_active":"2020-06-27T04:24:56.076651+0000","last_became_peered":"2020-06-27T04:24:56.076651+0000","last_unstale":"2020-06-27T04:25:09.107333+0000","last_undegraded":"2020-06-27T04:25:09.107333+0000","last_fullsized":"2020-06-27T04:25:09.107333+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.106235+0000","last_change":"2020-06-27T04:24:56.074118+0000","last_active":"2020-06-27T04:25:09.106235+0000","last_peered":"2020-06-27T04:25:09.106235+0000","last_clean":"2020-06-27T04:25:09.106235+0000","last_became_active":"2020-06-27T04:24:56.073721+0000","last_became_peered":"2020-06-27T04:24:56.073721+0000","last_unstale":"2020-06-27T04:25:09.106235+0000","last_undegraded":"2020-06-27T04:25:09.106235+0000","last_fullsized":"2020-06-27T04:25:09.106235+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.865794+0000","last_change":"2020-06-27T04:24:56.074612+0000","last_active":"2020-06-27T04:25:09.865794+0000","last_peered":"2020-06-27T04:25:09.865794+0000","last_clean":"2020-06-27T04:25:09.865794+0000","last_became_active":"2020-06-27T04:24:56.074182+0000","last_became_peered":"2020-06-27T04:24:56.074182+0000","last_unstale":"2020-06-27T04:25:09.865794+0000","last_undegraded":"2020-06-27T04:25:09.865794+0000","last_fullsized":"2020-06-27T04:25:09.865794+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"18'40","reported_seq":"49","reported_epoch":"18","state":"active+clean","last_fresh":"2020-06-27T04:25:12.935674+0000","last_change":"2020-06-27T04:25:09.109394+0000","last_active":"2020-06-27T04:25:12.935674+0000","last_peered":"2020-06-27T04:25:12.935674+0000","last_clean":"2020-06-27T04:25:12.935674+0000","last_became_active":"2020-06-27T04:25:09.109008+0000","last_became_peered":"2020-06-27T04:25:09.109008+0000","last_unstale":"2020-06-27T04:25:12.935674+0000","last_undegraded":"2020-06-27T04:25:12.935674+0000","last_fullsized":"2020-06-27T04:25:12.935674+0000","mapping_epoch":16,"log_start":"18'25","ondisk_log_start":"18'25","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:25:08.095579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:25:08.095579+0000","last_clean_scrub_stamp":"2020-06-27T04:25:08.095579+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19320,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.106312+0000","last_change":"2020-06-27T04:24:56.076822+0000","last_active":"2020-06-27T04:25:09.106312+0000","last_peered":"2020-06-27T04:25:09.106312+0000","last_clean":"2020-06-27T04:25:09.106312+0000","last_became_active":"2020-06-27T04:24:56.076459+0000","last_became_peered":"2020-06-27T04:24:56.076459+0000","last_unstale":"2020-06-27T04:25:09.106312+0000","last_undegraded":"2020-06-27T04:25:09.106312+0000","last_fullsized":"2020-06-27T04:25:09.106312+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.106432+0000","last_change":"2020-06-27T04:24:56.077607+0000","last_active":"2020-06-27T04:25:09.106432+0000","last_peered":"2020-06-27T04:25:09.106432+0000","last_clean":"2020-06-27T04:25:09.106432+0000","last_became_active":"2020-06-27T04:24:56.077200+0000","last_became_peered":"2020-06-27T04:24:56.077200+0000","last_unstale":"2020-06-27T04:25:09.106432+0000","last_undegraded":"2020-06-27T04:25:09.106432+0000","last_fullsized":"2020-06-27T04:25:09.106432+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2020-06-27T04:25:09.107375+0000","last_change":"2020-06-27T04:24:56.078601+0000","last_active":"2020-06-27T04:25:09.107375+0000","last_peered":"2020-06-27T04:25:09.107375+0000","last_clean":"2020-06-27T04:25:09.107375+0000","last_became_active":"2020-06-27T04:24:56.078202+0000","last_became_peered":"2020-06-27T04:24:56.078202+0000","last_unstale":"2020-06-27T04:25:09.107375+0000","last_undegraded":"2020-06-27T04:25:09.107375+0000","last_fullsized":"2020-06-27T04:25:09.107375+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-27T04:24:55.064327+0000","last_clean_scrub_stamp":"2020-06-27T04:24:55.064327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":19320,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":44919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048908,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322932,"statfs":{"total":96636764160,"available":95562682368,"internally_reserved":1073741824,"allocated":331776,"data_stored":60902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":40133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":54623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]}]}} 2020-06-27T04:25:18.514 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-06-27T04:25:18.514 INFO:tasks.divergent_priors2:blackholing osds [0, 1] 2020-06-27T04:25:18.515 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set objectstore_blackhole 1 2020-06-27T04:25:18.638 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:18.639 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "objectstore_blackhole = 'true' (not observed, change may require restart) " 2020-06-27T04:25:18.639 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:18.647 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set objectstore_blackhole 1 2020-06-27T04:25:18.771 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:18.771 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "objectstore_blackhole = 'true' (not observed, change may require restart) " 2020-06-27T04:25:18.771 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:18.779 INFO:tasks.divergent_priors2:writing divergent objects 2020-06-27T04:25:18.779 INFO:tasks.util.rados:rados -p foo put existing_0 /etc/resolv.conf 2020-06-27T04:25:18.780 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_0 /etc/resolv.conf 2020-06-27T04:25:18.782 INFO:tasks.util.rados:rados -p foo put existing_1 /etc/resolv.conf 2020-06-27T04:25:18.783 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_1 /etc/resolv.conf 2020-06-27T04:25:18.820 INFO:tasks.ceph.osd.2.smithi017.stderr:*** Caught signal (Segmentation fault) ** 2020-06-27T04:25:18.820 INFO:tasks.ceph.osd.2.smithi017.stderr: in thread 7f2794ab9700 thread_name:tp_osd_tp 2020-06-27T04:25:18.821 INFO:tasks.util.rados:rados -p foo put existing_2 /etc/resolv.conf 2020-06-27T04:25:18.822 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_2 /etc/resolv.conf 2020-06-27T04:25:18.822 INFO:tasks.ceph.osd.1.smithi017.stderr:*** Caught signal (Segmentation fault) ** 2020-06-27T04:25:18.823 INFO:tasks.ceph.osd.1.smithi017.stderr: in thread 7f1c7f372700 thread_name:tp_osd_tp 2020-06-27T04:25:18.824 INFO:tasks.ceph.osd.2.smithi017.stderr: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:25:18.824 INFO:tasks.ceph.osd.2.smithi017.stderr: 1: (()+0x12dc0) [0x7f27b8e2cdc0] 2020-06-27T04:25:18.824 INFO:tasks.ceph.osd.2.smithi017.stderr: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x558c2148f707] 2020-06-27T04:25:18.824 INFO:tasks.ceph.osd.2.smithi017.stderr: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x558c2148faa0] 2020-06-27T04:25:18.825 INFO:tasks.ceph.osd.2.smithi017.stderr: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x558c214c167a] 2020-06-27T04:25:18.825 INFO:tasks.ceph.osd.2.smithi017.stderr: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x558c214c2a57] 2020-06-27T04:25:18.825 INFO:tasks.ceph.osd.2.smithi017.stderr: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x558c2114d938] 2020-06-27T04:25:18.825 INFO:tasks.ceph.osd.2.smithi017.stderr: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x558c212fe03d] 2020-06-27T04:25:18.825 INFO:tasks.ceph.osd.2.smithi017.stderr: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x558c210bb5b0] 2020-06-27T04:25:18.830 INFO:tasks.ceph.osd.2.smithi017.stderr: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x558c2111489d] 2020-06-27T04:25:18.830 INFO:tasks.ceph.osd.2.smithi017.stderr: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x558c2111d380] 2020-06-27T04:25:18.830 INFO:tasks.ceph.osd.2.smithi017.stderr: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x558c21124590] 2020-06-27T04:25:18.831 INFO:tasks.ceph.osd.2.smithi017.stderr: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x558c20fa44e9] 2020-06-27T04:25:18.831 INFO:tasks.ceph.osd.2.smithi017.stderr: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x558c21208f78] 2020-06-27T04:25:18.831 INFO:tasks.ceph.osd.2.smithi017.stderr: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x558c20fc370f] 2020-06-27T04:25:18.831 INFO:tasks.ceph.osd.2.smithi017.stderr: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x558c21601b94] 2020-06-27T04:25:18.831 INFO:tasks.ceph.osd.2.smithi017.stderr: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x558c216047f4] 2020-06-27T04:25:18.832 INFO:tasks.ceph.osd.2.smithi017.stderr: 17: (()+0x82de) [0x7f27b8e222de] 2020-06-27T04:25:18.832 INFO:tasks.ceph.osd.2.smithi017.stderr: 18: (clone()+0x43) [0x7f27b7bcc133] 2020-06-27T04:25:18.832 INFO:tasks.ceph.osd.1.smithi017.stderr: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:25:18.832 INFO:tasks.ceph.osd.1.smithi017.stderr: 1: (()+0x12dc0) [0x7f1ca36e5dc0] 2020-06-27T04:25:18.832 INFO:tasks.ceph.osd.1.smithi017.stderr: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x56536b97c707] 2020-06-27T04:25:18.833 INFO:tasks.ceph.osd.1.smithi017.stderr: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x56536b97caa0] 2020-06-27T04:25:18.833 INFO:tasks.ceph.osd.1.smithi017.stderr: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x56536b9ae67a] 2020-06-27T04:25:18.833 INFO:tasks.ceph.osd.1.smithi017.stderr: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x56536b9afa57] 2020-06-27T04:25:18.833 INFO:tasks.ceph.osd.1.smithi017.stderr: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x56536b63a938] 2020-06-27T04:25:18.834 INFO:tasks.ceph.osd.1.smithi017.stderr: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x56536b7eea70] 2020-06-27T04:25:18.839 INFO:tasks.ceph.osd.1.smithi017.stderr: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x56536b7fedd7] 2020-06-27T04:25:18.839 INFO:tasks.ceph.osd.1.smithi017.stderr: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x56536b66d252] 2020-06-27T04:25:18.839 INFO:tasks.ceph.osd.1.smithi017.stderr: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x56536b610e2e] 2020-06-27T04:25:18.839 INFO:tasks.ceph.osd.1.smithi017.stderr: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x56536b4914e9] 2020-06-27T04:25:18.839 INFO:tasks.ceph.osd.1.smithi017.stderr: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x56536b6f5f78] 2020-06-27T04:25:18.840 INFO:tasks.ceph.osd.1.smithi017.stderr: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x56536b4b070f] 2020-06-27T04:25:18.840 INFO:tasks.ceph.osd.1.smithi017.stderr: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x56536baeeb94] 2020-06-27T04:25:18.840 INFO:tasks.ceph.osd.1.smithi017.stderr: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x56536baf17f4] 2020-06-27T04:25:18.840 INFO:tasks.ceph.osd.1.smithi017.stderr: 16: (()+0x82de) [0x7f1ca36db2de] 2020-06-27T04:25:18.840 INFO:tasks.ceph.osd.1.smithi017.stderr: 17: (clone()+0x43) [0x7f1ca2485133] 2020-06-27T04:25:18.841 INFO:tasks.util.rados:rados -p foo put existing_3 /etc/resolv.conf 2020-06-27T04:25:18.842 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_3 /etc/resolv.conf 2020-06-27T04:25:18.842 INFO:tasks.ceph.osd.1.smithi017.stderr:2020-06-27T04:25:18.821+0000 7f1c7f372700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:25:18.843 INFO:tasks.ceph.osd.1.smithi017.stderr: in thread 7f1c7f372700 thread_name:tp_osd_tp 2020-06-27T04:25:18.843 INFO:tasks.ceph.osd.1.smithi017.stderr: 2020-06-27T04:25:18.843 INFO:tasks.ceph.osd.1.smithi017.stderr: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:25:18.843 INFO:tasks.ceph.osd.1.smithi017.stderr: 1: (()+0x12dc0) [0x7f1ca36e5dc0] 2020-06-27T04:25:18.844 INFO:tasks.ceph.osd.1.smithi017.stderr: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x56536b97c707] 2020-06-27T04:25:18.844 INFO:tasks.ceph.osd.1.smithi017.stderr: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x56536b97caa0] 2020-06-27T04:25:18.844 INFO:tasks.ceph.osd.1.smithi017.stderr: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x56536b9ae67a] 2020-06-27T04:25:18.844 INFO:tasks.ceph.osd.1.smithi017.stderr: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x56536b9afa57] 2020-06-27T04:25:18.844 INFO:tasks.ceph.osd.1.smithi017.stderr: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x56536b63a938] 2020-06-27T04:25:18.844 INFO:tasks.ceph.osd.1.smithi017.stderr: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x56536b7eea70] 2020-06-27T04:25:18.845 INFO:tasks.ceph.osd.1.smithi017.stderr: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x56536b7fedd7] 2020-06-27T04:25:18.845 INFO:tasks.ceph.osd.1.smithi017.stderr: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x56536b66d252] 2020-06-27T04:25:18.845 INFO:tasks.ceph.osd.1.smithi017.stderr: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x56536b610e2e] 2020-06-27T04:25:18.845 INFO:tasks.ceph.osd.1.smithi017.stderr: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x56536b4914e9] 2020-06-27T04:25:18.845 INFO:tasks.ceph.osd.1.smithi017.stderr: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x56536b6f5f78] 2020-06-27T04:25:18.846 INFO:tasks.ceph.osd.1.smithi017.stderr: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x56536b4b070f] 2020-06-27T04:25:18.846 INFO:tasks.ceph.osd.1.smithi017.stderr: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x56536baeeb94] 2020-06-27T04:25:18.846 INFO:tasks.ceph.osd.1.smithi017.stderr: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x56536baf17f4] 2020-06-27T04:25:18.846 INFO:tasks.ceph.osd.1.smithi017.stderr: 16: (()+0x82de) [0x7f1ca36db2de] 2020-06-27T04:25:18.846 INFO:tasks.ceph.osd.1.smithi017.stderr: 17: (clone()+0x43) [0x7f1ca2485133] 2020-06-27T04:25:18.847 INFO:tasks.ceph.osd.1.smithi017.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:25:18.847 INFO:tasks.ceph.osd.1.smithi017.stderr: 2020-06-27T04:25:18.847 INFO:tasks.ceph.osd.1.smithi017.stderr: 0> 2020-06-27T04:25:18.821+0000 7f1c7f372700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:25:18.847 INFO:tasks.ceph.osd.1.smithi017.stderr: in thread 7f1c7f372700 thread_name:tp_osd_tp 2020-06-27T04:25:18.847 INFO:tasks.ceph.osd.1.smithi017.stderr: 2020-06-27T04:25:18.847 INFO:tasks.ceph.osd.1.smithi017.stderr: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:25:18.848 INFO:tasks.ceph.osd.1.smithi017.stderr: 1: (()+0x12dc0) [0x7f1ca36e5dc0] 2020-06-27T04:25:18.848 INFO:tasks.ceph.osd.1.smithi017.stderr: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x56536b97c707] 2020-06-27T04:25:18.848 INFO:tasks.ceph.osd.1.smithi017.stderr: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x56536b97caa0] 2020-06-27T04:25:18.848 INFO:tasks.ceph.osd.1.smithi017.stderr: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x56536b9ae67a] 2020-06-27T04:25:18.848 INFO:tasks.ceph.osd.1.smithi017.stderr: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x56536b9afa57] 2020-06-27T04:25:18.849 INFO:tasks.ceph.osd.1.smithi017.stderr: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x56536b63a938] 2020-06-27T04:25:18.849 INFO:tasks.ceph.osd.1.smithi017.stderr: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x56536b7eea70] 2020-06-27T04:25:18.849 INFO:tasks.ceph.osd.1.smithi017.stderr: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x56536b7fedd7] 2020-06-27T04:25:18.849 INFO:tasks.ceph.osd.1.smithi017.stderr: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x56536b66d252] 2020-06-27T04:25:18.849 INFO:tasks.ceph.osd.1.smithi017.stderr: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x56536b610e2e] 2020-06-27T04:25:18.850 INFO:tasks.ceph.osd.1.smithi017.stderr: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x56536b4914e9] 2020-06-27T04:25:18.850 INFO:tasks.ceph.osd.1.smithi017.stderr: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x56536b6f5f78] 2020-06-27T04:25:18.850 INFO:tasks.ceph.osd.1.smithi017.stderr: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x56536b4b070f] 2020-06-27T04:25:18.850 INFO:tasks.ceph.osd.1.smithi017.stderr: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x56536baeeb94] 2020-06-27T04:25:18.850 INFO:tasks.ceph.osd.1.smithi017.stderr: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x56536baf17f4] 2020-06-27T04:25:18.850 INFO:tasks.ceph.osd.1.smithi017.stderr: 16: (()+0x82de) [0x7f1ca36db2de] 2020-06-27T04:25:18.851 INFO:tasks.ceph.osd.1.smithi017.stderr: 17: (clone()+0x43) [0x7f1ca2485133] 2020-06-27T04:25:18.851 INFO:tasks.ceph.osd.1.smithi017.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:25:18.851 INFO:tasks.ceph.osd.1.smithi017.stderr: 2020-06-27T04:25:18.851 INFO:tasks.ceph.osd.2.smithi017.stderr:2020-06-27T04:25:18.821+0000 7f2794ab9700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:25:18.851 INFO:tasks.ceph.osd.2.smithi017.stderr: in thread 7f2794ab9700 thread_name:tp_osd_tp 2020-06-27T04:25:18.852 INFO:tasks.ceph.osd.2.smithi017.stderr: 2020-06-27T04:25:18.852 INFO:tasks.ceph.osd.2.smithi017.stderr: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:25:18.852 INFO:tasks.ceph.osd.2.smithi017.stderr: 1: (()+0x12dc0) [0x7f27b8e2cdc0] 2020-06-27T04:25:18.852 INFO:tasks.ceph.osd.2.smithi017.stderr: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x558c2148f707] 2020-06-27T04:25:18.853 INFO:tasks.ceph.osd.2.smithi017.stderr: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x558c2148faa0] 2020-06-27T04:25:18.853 INFO:tasks.ceph.osd.2.smithi017.stderr: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x558c214c167a] 2020-06-27T04:25:18.853 INFO:tasks.ceph.osd.2.smithi017.stderr: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x558c214c2a57] 2020-06-27T04:25:18.853 INFO:tasks.ceph.osd.2.smithi017.stderr: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x558c2114d938] 2020-06-27T04:25:18.853 INFO:tasks.ceph.osd.2.smithi017.stderr: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x558c212fe03d] 2020-06-27T04:25:18.854 INFO:tasks.ceph.osd.2.smithi017.stderr: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x558c210bb5b0] 2020-06-27T04:25:18.854 INFO:tasks.ceph.osd.2.smithi017.stderr: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x558c2111489d] 2020-06-27T04:25:18.854 INFO:tasks.ceph.osd.2.smithi017.stderr: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x558c2111d380] 2020-06-27T04:25:18.854 INFO:tasks.ceph.osd.2.smithi017.stderr: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x558c21124590] 2020-06-27T04:25:18.854 INFO:tasks.ceph.osd.2.smithi017.stderr: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x558c20fa44e9] 2020-06-27T04:25:18.855 INFO:tasks.ceph.osd.2.smithi017.stderr: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x558c21208f78] 2020-06-27T04:25:18.855 INFO:tasks.ceph.osd.2.smithi017.stderr: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x558c20fc370f] 2020-06-27T04:25:18.855 INFO:tasks.ceph.osd.2.smithi017.stderr: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x558c21601b94] 2020-06-27T04:25:18.855 INFO:tasks.ceph.osd.2.smithi017.stderr: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x558c216047f4] 2020-06-27T04:25:18.855 INFO:tasks.ceph.osd.2.smithi017.stderr: 17: (()+0x82de) [0x7f27b8e222de] 2020-06-27T04:25:18.855 INFO:tasks.ceph.osd.2.smithi017.stderr: 18: (clone()+0x43) [0x7f27b7bcc133] 2020-06-27T04:25:18.856 INFO:tasks.ceph.osd.2.smithi017.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:25:18.856 INFO:tasks.ceph.osd.2.smithi017.stderr: 2020-06-27T04:25:18.857 INFO:tasks.ceph.osd.2.smithi017.stderr: 0> 2020-06-27T04:25:18.821+0000 7f2794ab9700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:25:18.857 INFO:tasks.ceph.osd.2.smithi017.stderr: in thread 7f2794ab9700 thread_name:tp_osd_tp 2020-06-27T04:25:18.857 INFO:tasks.ceph.osd.2.smithi017.stderr: 2020-06-27T04:25:18.858 INFO:tasks.ceph.osd.2.smithi017.stderr: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:25:18.858 INFO:tasks.ceph.osd.2.smithi017.stderr: 1: (()+0x12dc0) [0x7f27b8e2cdc0] 2020-06-27T04:25:18.858 INFO:tasks.ceph.osd.2.smithi017.stderr: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x558c2148f707] 2020-06-27T04:25:18.858 INFO:tasks.ceph.osd.2.smithi017.stderr: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x558c2148faa0] 2020-06-27T04:25:18.858 INFO:tasks.ceph.osd.2.smithi017.stderr: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x558c214c167a] 2020-06-27T04:25:18.859 INFO:tasks.ceph.osd.2.smithi017.stderr: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x558c214c2a57] 2020-06-27T04:25:18.859 INFO:tasks.ceph.osd.2.smithi017.stderr: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x558c2114d938] 2020-06-27T04:25:18.859 INFO:tasks.ceph.osd.2.smithi017.stderr: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x558c212fe03d] 2020-06-27T04:25:18.859 INFO:tasks.ceph.osd.2.smithi017.stderr: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x558c210bb5b0] 2020-06-27T04:25:18.859 INFO:tasks.ceph.osd.2.smithi017.stderr: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x558c2111489d] 2020-06-27T04:25:18.859 INFO:tasks.ceph.osd.2.smithi017.stderr: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x558c2111d380] 2020-06-27T04:25:18.860 INFO:tasks.ceph.osd.2.smithi017.stderr: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x558c21124590] 2020-06-27T04:25:18.860 INFO:tasks.ceph.osd.2.smithi017.stderr: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x558c20fa44e9] 2020-06-27T04:25:18.860 INFO:tasks.ceph.osd.2.smithi017.stderr: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x558c21208f78] 2020-06-27T04:25:18.860 INFO:tasks.ceph.osd.2.smithi017.stderr: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x558c20fc370f] 2020-06-27T04:25:18.860 INFO:tasks.ceph.osd.2.smithi017.stderr: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x558c21601b94] 2020-06-27T04:25:18.861 INFO:tasks.ceph.osd.2.smithi017.stderr: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x558c216047f4] 2020-06-27T04:25:18.861 INFO:tasks.ceph.osd.2.smithi017.stderr: 17: (()+0x82de) [0x7f27b8e222de] 2020-06-27T04:25:18.861 INFO:tasks.ceph.osd.2.smithi017.stderr: 18: (clone()+0x43) [0x7f27b7bcc133] 2020-06-27T04:25:18.861 INFO:tasks.ceph.osd.2.smithi017.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:25:18.861 INFO:tasks.ceph.osd.2.smithi017.stderr: 2020-06-27T04:25:18.862 INFO:tasks.ceph.osd.1.smithi017.stderr: -1> 2020-06-27T04:25:18.821+0000 7f1c7f372700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:25:18.862 INFO:tasks.ceph.osd.1.smithi017.stderr: in thread 7f1c7f372700 thread_name:tp_osd_tp 2020-06-27T04:25:18.862 INFO:tasks.ceph.osd.1.smithi017.stderr: 2020-06-27T04:25:18.862 INFO:tasks.ceph.osd.1.smithi017.stderr: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:25:18.862 INFO:tasks.ceph.osd.1.smithi017.stderr: 1: (()+0x12dc0) [0x7f1ca36e5dc0] 2020-06-27T04:25:18.863 INFO:tasks.ceph.osd.1.smithi017.stderr: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x56536b97c707] 2020-06-27T04:25:18.863 INFO:tasks.ceph.osd.1.smithi017.stderr: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x56536b97caa0] 2020-06-27T04:25:18.863 INFO:tasks.ceph.osd.1.smithi017.stderr: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x56536b9ae67a] 2020-06-27T04:25:18.863 INFO:tasks.ceph.osd.1.smithi017.stderr: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x56536b9afa57] 2020-06-27T04:25:18.863 INFO:tasks.ceph.osd.1.smithi017.stderr: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x56536b63a938] 2020-06-27T04:25:18.863 INFO:tasks.ceph.osd.1.smithi017.stderr: 7: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x56536b7eea70] 2020-06-27T04:25:18.864 INFO:tasks.ceph.osd.1.smithi017.stderr: 8: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x56536b7fedd7] 2020-06-27T04:25:18.864 INFO:tasks.ceph.osd.1.smithi017.stderr: 9: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x56536b66d252] 2020-06-27T04:25:18.864 INFO:tasks.ceph.osd.1.smithi017.stderr: 10: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x56536b610e2e] 2020-06-27T04:25:18.864 INFO:tasks.ceph.osd.1.smithi017.stderr: 11: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x56536b4914e9] 2020-06-27T04:25:18.864 INFO:tasks.ceph.osd.1.smithi017.stderr: 12: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x56536b6f5f78] 2020-06-27T04:25:18.865 INFO:tasks.ceph.osd.1.smithi017.stderr: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x56536b4b070f] 2020-06-27T04:25:18.865 INFO:tasks.ceph.osd.1.smithi017.stderr: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x56536baeeb94] 2020-06-27T04:25:18.865 INFO:tasks.ceph.osd.1.smithi017.stderr: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x56536baf17f4] 2020-06-27T04:25:18.865 INFO:tasks.ceph.osd.1.smithi017.stderr: 16: (()+0x82de) [0x7f1ca36db2de] 2020-06-27T04:25:18.865 INFO:tasks.ceph.osd.1.smithi017.stderr: 17: (clone()+0x43) [0x7f1ca2485133] 2020-06-27T04:25:18.866 INFO:tasks.ceph.osd.1.smithi017.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:25:18.866 INFO:tasks.ceph.osd.1.smithi017.stderr: 2020-06-27T04:25:18.866 INFO:tasks.ceph.osd.2.smithi017.stderr: 0> 2020-06-27T04:25:18.821+0000 7f2794ab9700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:25:18.866 INFO:tasks.ceph.osd.2.smithi017.stderr: in thread 7f2794ab9700 thread_name:tp_osd_tp 2020-06-27T04:25:18.867 INFO:tasks.ceph.osd.2.smithi017.stderr: 2020-06-27T04:25:18.867 INFO:tasks.ceph.osd.2.smithi017.stderr: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:25:18.867 INFO:tasks.ceph.osd.2.smithi017.stderr: 1: (()+0x12dc0) [0x7f27b8e2cdc0] 2020-06-27T04:25:18.867 INFO:tasks.ceph.osd.2.smithi017.stderr: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x558c2148f707] 2020-06-27T04:25:18.867 INFO:tasks.ceph.osd.2.smithi017.stderr: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x558c2148faa0] 2020-06-27T04:25:18.868 INFO:tasks.ceph.osd.2.smithi017.stderr: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x558c214c167a] 2020-06-27T04:25:18.868 INFO:tasks.ceph.osd.2.smithi017.stderr: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x558c214c2a57] 2020-06-27T04:25:18.868 INFO:tasks.ceph.osd.2.smithi017.stderr: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x558c2114d938] 2020-06-27T04:25:18.868 INFO:tasks.ceph.osd.2.smithi017.stderr: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x558c212fe03d] 2020-06-27T04:25:18.868 INFO:tasks.ceph.osd.2.smithi017.stderr: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x558c210bb5b0] 2020-06-27T04:25:18.869 INFO:tasks.ceph.osd.2.smithi017.stderr: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x558c2111489d] 2020-06-27T04:25:18.869 INFO:tasks.ceph.osd.2.smithi017.stderr: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x558c2111d380] 2020-06-27T04:25:18.869 INFO:tasks.ceph.osd.2.smithi017.stderr: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x558c21124590] 2020-06-27T04:25:18.869 INFO:tasks.ceph.osd.2.smithi017.stderr: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x558c20fa44e9] 2020-06-27T04:25:18.869 INFO:tasks.ceph.osd.2.smithi017.stderr: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x558c21208f78] 2020-06-27T04:25:18.870 INFO:tasks.ceph.osd.2.smithi017.stderr: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x558c20fc370f] 2020-06-27T04:25:18.870 INFO:tasks.ceph.osd.2.smithi017.stderr: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x558c21601b94] 2020-06-27T04:25:18.870 INFO:tasks.ceph.osd.2.smithi017.stderr: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x558c216047f4] 2020-06-27T04:25:18.870 INFO:tasks.ceph.osd.2.smithi017.stderr: 17: (()+0x82de) [0x7f27b8e222de] 2020-06-27T04:25:18.870 INFO:tasks.ceph.osd.2.smithi017.stderr: 18: (clone()+0x43) [0x7f27b7bcc133] 2020-06-27T04:25:18.870 INFO:tasks.ceph.osd.2.smithi017.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:25:18.871 INFO:tasks.ceph.osd.2.smithi017.stderr: 2020-06-27T04:25:18.871 INFO:tasks.util.rados:rados -p foo put existing_4 /etc/resolv.conf 2020-06-27T04:25:18.872 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_4 /etc/resolv.conf 2020-06-27T04:25:18.914 INFO:tasks.divergent_priors2:remove divergent objects 2020-06-27T04:25:18.915 INFO:tasks.util.rados:rados -p foo rm existing_5 2020-06-27T04:25:18.915 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo rm existing_5 2020-06-27T04:25:18.958 INFO:tasks.util.rados:rados -p foo rm existing_6 2020-06-27T04:25:18.958 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo rm existing_6 2020-06-27T04:25:19.001 INFO:tasks.util.rados:rados -p foo rm existing_7 2020-06-27T04:25:19.001 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo rm existing_7 2020-06-27T04:25:19.044 INFO:tasks.util.rados:rados -p foo rm existing_8 2020-06-27T04:25:19.044 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo rm existing_8 2020-06-27T04:25:19.088 INFO:tasks.util.rados:rados -p foo rm existing_9 2020-06-27T04:25:19.089 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo rm existing_9 2020-06-27T04:25:19.805 INFO:tasks.ceph.osd.1.smithi017.stderr:daemon-helper: command crashed with signal 11 2020-06-27T04:25:19.825 INFO:tasks.ceph.osd.2.smithi017.stderr:daemon-helper: command crashed with signal 11 2020-06-27T04:25:23.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2020-06-27T04:25:23.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2020-06-27T04:25:29.135 INFO:teuthology.orchestra.run.smithi017:> killall -9 rados 2020-06-27T04:25:29.193 INFO:tasks.divergent_priors2:killing all the osds 2020-06-27T04:25:29.194 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2020-06-27T04:25:29.194 INFO:teuthology.orchestra.run:waiting for 300 2020-06-27T04:25:29.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~5s 2020-06-27T04:25:29.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~5s 2020-06-27T04:25:29.249 INFO:tasks.ceph.osd.0:Stopped 2020-06-27T04:25:29.249 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-06-27T04:25:29.249 INFO:teuthology.orchestra.run:waiting for 300 2020-06-27T04:25:29.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-27T04:25:29.250 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 470, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 182, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi017 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' 2020-06-27T04:25:29.251 INFO:tasks.ceph.osd.1:Stopped 2020-06-27T04:25:29.251 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-06-27T04:25:29.251 INFO:teuthology.orchestra.run:waiting for 300 2020-06-27T04:25:29.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-27T04:25:29.252 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 470, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 182, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi017 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' 2020-06-27T04:25:29.253 INFO:tasks.ceph.osd.2:Stopped 2020-06-27T04:25:29.253 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd down 0 2020-06-27T04:25:29.598 INFO:tasks.ceph.mon.a.smithi017.stderr:2020-06-27T04:25:29.594+0000 7f9e44953700 -1 mon.a@0(leader).osd e18 definitely_dead 0 2020-06-27T04:25:30.498 INFO:teuthology.orchestra.run.smithi017.stderr:marked down osd.0. 2020-06-27T04:25:30.510 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd down 1 2020-06-27T04:25:30.813 INFO:tasks.ceph.mon.a.smithi017.stderr:2020-06-27T04:25:30.809+0000 7f9e44953700 -1 mon.a@0(leader).osd e19 definitely_dead 0 2020-06-27T04:25:31.501 INFO:teuthology.orchestra.run.smithi017.stderr:marked down osd.1. 2020-06-27T04:25:31.513 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd down 2 2020-06-27T04:25:31.809 INFO:tasks.ceph.mon.a.smithi017.stderr:2020-06-27T04:25:31.806+0000 7f9e44953700 -1 mon.a@0(leader).osd e20 definitely_dead 0 2020-06-27T04:25:32.503 INFO:teuthology.orchestra.run.smithi017.stderr:marked down osd.2. 2020-06-27T04:25:32.516 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd out 0 2020-06-27T04:25:32.817 INFO:tasks.ceph.mon.a.smithi017.stderr:2020-06-27T04:25:32.815+0000 7f9e44953700 -1 mon.a@0(leader).osd e21 definitely_dead 0 2020-06-27T04:25:33.514 INFO:teuthology.orchestra.run.smithi017.stderr:marked out osd.0. 2020-06-27T04:25:33.525 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd out 1 2020-06-27T04:25:33.829 INFO:tasks.ceph.mon.a.smithi017.stderr:2020-06-27T04:25:33.826+0000 7f9e44953700 -1 mon.a@0(leader).osd e22 definitely_dead 0 2020-06-27T04:25:34.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2020-06-27T04:25:34.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2020-06-27T04:25:34.514 INFO:teuthology.orchestra.run.smithi017.stderr:marked out osd.1. 2020-06-27T04:25:34.526 INFO:tasks.divergent_priors2:bringing up non_divergent [0, 1] 2020-06-27T04:25:34.526 INFO:tasks.ceph.osd.0:Restarting daemon 2020-06-27T04:25:34.527 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-06-27T04:25:34.529 INFO:tasks.ceph.osd.0:Started 2020-06-27T04:25:34.536 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-27T04:25:34.665 INFO:teuthology.orchestra.run.smithi017.stderr:no valid command found; 10 closest matches: 2020-06-27T04:25:34.665 INFO:teuthology.orchestra.run.smithi017.stderr:0 2020-06-27T04:25:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:1 2020-06-27T04:25:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2 2020-06-27T04:25:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:abort 2020-06-27T04:25:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:assert 2020-06-27T04:25:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:config diff 2020-06-27T04:25:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:config diff get 2020-06-27T04:25:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:config get 2020-06-27T04:25:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:config help [] 2020-06-27T04:25:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:config set ... 2020-06-27T04:25:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:admin_socket: invalid command 2020-06-27T04:25:34.668 DEBUG:teuthology.orchestra.run:got remote process result: 22 2020-06-27T04:25:34.669 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2020-06-27T04:25:35.133 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:25:35.130+0000 7fe5d7601ec0 -1 Falling back to public interface 2020-06-27T04:25:36.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:25:36.233+0000 7fe5d7601ec0 -1 osd.0 18 log_to_monitors {default=true} 2020-06-27T04:25:39.670 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-27T04:25:39.809 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:39.809 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2020-06-27T04:25:39.809 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2020-06-27T04:25:39.810 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:39.818 INFO:tasks.ceph.osd.1:Restarting daemon 2020-06-27T04:25:39.819 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-06-27T04:25:39.822 INFO:tasks.ceph.osd.1:Started 2020-06-27T04:25:39.822 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-27T04:25:39.964 INFO:teuthology.orchestra.run.smithi017.stderr:no valid command found; 10 closest matches: 2020-06-27T04:25:39.964 INFO:teuthology.orchestra.run.smithi017.stderr:0 2020-06-27T04:25:39.964 INFO:teuthology.orchestra.run.smithi017.stderr:1 2020-06-27T04:25:39.964 INFO:teuthology.orchestra.run.smithi017.stderr:2 2020-06-27T04:25:39.965 INFO:teuthology.orchestra.run.smithi017.stderr:abort 2020-06-27T04:25:39.977 INFO:teuthology.orchestra.run.smithi017.stderr:assert 2020-06-27T04:25:39.977 INFO:teuthology.orchestra.run.smithi017.stderr:config diff 2020-06-27T04:25:39.977 INFO:teuthology.orchestra.run.smithi017.stderr:config diff get 2020-06-27T04:25:39.977 INFO:teuthology.orchestra.run.smithi017.stderr:config get 2020-06-27T04:25:39.978 INFO:teuthology.orchestra.run.smithi017.stderr:config help [] 2020-06-27T04:25:39.978 INFO:teuthology.orchestra.run.smithi017.stderr:config set ... 2020-06-27T04:25:39.978 INFO:teuthology.orchestra.run.smithi017.stderr:admin_socket: invalid command 2020-06-27T04:25:39.979 DEBUG:teuthology.orchestra.run:got remote process result: 22 2020-06-27T04:25:39.979 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2020-06-27T04:25:40.418 INFO:tasks.ceph.osd.1.smithi017.stderr:2020-06-27T04:25:40.415+0000 7fc8ff37bec0 -1 Falling back to public interface 2020-06-27T04:25:41.508 INFO:tasks.ceph.osd.1.smithi017.stderr:2020-06-27T04:25:41.506+0000 7fc8ff37bec0 -1 osd.1 18 log_to_monitors {default=true} 2020-06-27T04:25:44.981 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-27T04:25:45.119 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2020-06-27T04:25:45.119 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2020-06-27T04:25:45.119 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2020-06-27T04:25:45.119 INFO:teuthology.orchestra.run.smithi017.stdout:} 2020-06-27T04:25:45.128 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd in 0 2020-06-27T04:25:45.419 INFO:tasks.ceph.mon.a.smithi017.stderr:2020-06-27T04:25:45.417+0000 7f9e44953700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2020-06-27T04:25:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:marked in osd.0. 2020-06-27T04:25:45.545 INFO:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd in 1 2020-06-27T04:25:45.839 INFO:tasks.ceph.mon.a.smithi017.stderr:2020-06-27T04:25:45.837+0000 7f9e44953700 -1 mon.a@0(leader).osd e26 definitely_dead 0 2020-06-27T04:25:46.540 INFO:teuthology.orchestra.run.smithi017.stderr:marked in osd.1. 2020-06-27T04:25:46.554 INFO:tasks.divergent_priors2:writing non-divergent object existing_10 2020-06-27T04:25:46.555 INFO:tasks.util.rados:rados -p foo put existing_10 /etc/resolv.conf 2020-06-27T04:25:46.555 INFO:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_10 /etc/resolv.conf 2020-06-27T04:25:47.553 INFO:tasks.ceph.osd.1.smithi017.stderr:*** Caught signal (Segmentation fault) ** 2020-06-27T04:25:47.554 INFO:tasks.ceph.osd.1.smithi017.stderr: in thread 7fc8d4d78700 thread_name:tp_osd_tp 2020-06-27T04:25:47.557 INFO:tasks.ceph.osd.1.smithi017.stderr: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:25:47.557 INFO:tasks.ceph.osd.1.smithi017.stderr: 1: (()+0x12dc0) [0x7fc8fd0f3dc0] 2020-06-27T04:25:47.558 INFO:tasks.ceph.osd.1.smithi017.stderr: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b1a6580707] 2020-06-27T04:25:47.558 INFO:tasks.ceph.osd.1.smithi017.stderr: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b1a6580aa0] 2020-06-27T04:25:47.558 INFO:tasks.ceph.osd.1.smithi017.stderr: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b1a65b267a] 2020-06-27T04:25:47.558 INFO:tasks.ceph.osd.1.smithi017.stderr: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b1a65b3a57] 2020-06-27T04:25:47.558 INFO:tasks.ceph.osd.1.smithi017.stderr: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b1a623e938] 2020-06-27T04:25:47.559 INFO:tasks.ceph.osd.1.smithi017.stderr: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b1a63ef03d] 2020-06-27T04:25:47.559 INFO:tasks.ceph.osd.1.smithi017.stderr: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b1a61ac5b0] 2020-06-27T04:25:47.559 INFO:tasks.ceph.osd.1.smithi017.stderr: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b1a620589d] 2020-06-27T04:25:47.559 INFO:tasks.ceph.osd.1.smithi017.stderr: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b1a620e380] 2020-06-27T04:25:47.559 INFO:tasks.ceph.osd.1.smithi017.stderr: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b1a6215590] 2020-06-27T04:25:47.560 INFO:tasks.ceph.osd.1.smithi017.stderr: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b1a60954e9] 2020-06-27T04:25:47.560 INFO:tasks.ceph.osd.1.smithi017.stderr: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b1a62f9f78] 2020-06-27T04:25:47.560 INFO:tasks.ceph.osd.1.smithi017.stderr: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b1a60b470f] 2020-06-27T04:25:47.560 INFO:tasks.ceph.osd.1.smithi017.stderr: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b1a66f2b94] 2020-06-27T04:25:47.560 INFO:tasks.ceph.osd.1.smithi017.stderr: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b1a66f57f4] 2020-06-27T04:25:47.561 INFO:tasks.ceph.osd.1.smithi017.stderr: 17: (()+0x82de) [0x7fc8fd0e92de] 2020-06-27T04:25:47.561 INFO:tasks.ceph.osd.1.smithi017.stderr: 18: (clone()+0x43) [0x7fc8fbe93133] 2020-06-27T04:25:47.563 INFO:tasks.ceph.osd.1.smithi017.stderr:2020-06-27T04:25:47.555+0000 7fc8d4d78700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:25:47.565 INFO:tasks.ceph.osd.1.smithi017.stderr: in thread 7fc8d4d78700 thread_name:tp_osd_tp 2020-06-27T04:25:47.565 INFO:tasks.ceph.osd.1.smithi017.stderr: 2020-06-27T04:25:47.565 INFO:tasks.ceph.osd.1.smithi017.stderr: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:25:47.565 INFO:tasks.ceph.osd.1.smithi017.stderr: 1: (()+0x12dc0) [0x7fc8fd0f3dc0] 2020-06-27T04:25:47.565 INFO:tasks.ceph.osd.1.smithi017.stderr: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b1a6580707] 2020-06-27T04:25:47.566 INFO:tasks.ceph.osd.1.smithi017.stderr: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b1a6580aa0] 2020-06-27T04:25:47.566 INFO:tasks.ceph.osd.1.smithi017.stderr: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b1a65b267a] 2020-06-27T04:25:47.566 INFO:tasks.ceph.osd.1.smithi017.stderr: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b1a65b3a57] 2020-06-27T04:25:47.566 INFO:tasks.ceph.osd.1.smithi017.stderr: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b1a623e938] 2020-06-27T04:25:47.567 INFO:tasks.ceph.osd.1.smithi017.stderr: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b1a63ef03d] 2020-06-27T04:25:47.567 INFO:tasks.ceph.osd.1.smithi017.stderr: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b1a61ac5b0] 2020-06-27T04:25:47.567 INFO:tasks.ceph.osd.1.smithi017.stderr: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b1a620589d] 2020-06-27T04:25:47.567 INFO:tasks.ceph.osd.1.smithi017.stderr: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b1a620e380] 2020-06-27T04:25:47.567 INFO:tasks.ceph.osd.1.smithi017.stderr: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b1a6215590] 2020-06-27T04:25:47.568 INFO:tasks.ceph.osd.1.smithi017.stderr: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b1a60954e9] 2020-06-27T04:25:47.568 INFO:tasks.ceph.osd.1.smithi017.stderr: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b1a62f9f78] 2020-06-27T04:25:47.568 INFO:tasks.ceph.osd.1.smithi017.stderr: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b1a60b470f] 2020-06-27T04:25:47.569 INFO:tasks.ceph.osd.1.smithi017.stderr: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b1a66f2b94] 2020-06-27T04:25:47.569 INFO:tasks.ceph.osd.1.smithi017.stderr: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b1a66f57f4] 2020-06-27T04:25:47.569 INFO:tasks.ceph.osd.1.smithi017.stderr: 17: (()+0x82de) [0x7fc8fd0e92de] 2020-06-27T04:25:47.570 INFO:tasks.ceph.osd.1.smithi017.stderr: 18: (clone()+0x43) [0x7fc8fbe93133] 2020-06-27T04:25:47.570 INFO:tasks.ceph.osd.1.smithi017.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:25:47.570 INFO:tasks.ceph.osd.1.smithi017.stderr: 2020-06-27T04:25:47.574 INFO:tasks.ceph.osd.1.smithi017.stderr: 0> 2020-06-27T04:25:47.555+0000 7fc8d4d78700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:25:47.574 INFO:tasks.ceph.osd.1.smithi017.stderr: in thread 7fc8d4d78700 thread_name:tp_osd_tp 2020-06-27T04:25:47.574 INFO:tasks.ceph.osd.1.smithi017.stderr: 2020-06-27T04:25:47.574 INFO:tasks.ceph.osd.1.smithi017.stderr: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:25:47.574 INFO:tasks.ceph.osd.1.smithi017.stderr: 1: (()+0x12dc0) [0x7fc8fd0f3dc0] 2020-06-27T04:25:47.576 INFO:tasks.ceph.osd.1.smithi017.stderr: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b1a6580707] 2020-06-27T04:25:47.576 INFO:tasks.ceph.osd.1.smithi017.stderr: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b1a6580aa0] 2020-06-27T04:25:47.576 INFO:tasks.ceph.osd.1.smithi017.stderr: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b1a65b267a] 2020-06-27T04:25:47.577 INFO:tasks.ceph.osd.1.smithi017.stderr: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b1a65b3a57] 2020-06-27T04:25:47.577 INFO:tasks.ceph.osd.1.smithi017.stderr: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b1a623e938] 2020-06-27T04:25:47.577 INFO:tasks.ceph.osd.1.smithi017.stderr: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b1a63ef03d] 2020-06-27T04:25:47.577 INFO:tasks.ceph.osd.1.smithi017.stderr: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b1a61ac5b0] 2020-06-27T04:25:47.577 INFO:tasks.ceph.osd.1.smithi017.stderr: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b1a620589d] 2020-06-27T04:25:47.578 INFO:tasks.ceph.osd.1.smithi017.stderr: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b1a620e380] 2020-06-27T04:25:47.578 INFO:tasks.ceph.osd.1.smithi017.stderr: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b1a6215590] 2020-06-27T04:25:47.578 INFO:tasks.ceph.osd.1.smithi017.stderr: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b1a60954e9] 2020-06-27T04:25:47.578 INFO:tasks.ceph.osd.1.smithi017.stderr: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b1a62f9f78] 2020-06-27T04:25:47.578 INFO:tasks.ceph.osd.1.smithi017.stderr: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b1a60b470f] 2020-06-27T04:25:47.579 INFO:tasks.ceph.osd.1.smithi017.stderr: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b1a66f2b94] 2020-06-27T04:25:47.579 INFO:tasks.ceph.osd.1.smithi017.stderr: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b1a66f57f4] 2020-06-27T04:25:47.579 INFO:tasks.ceph.osd.1.smithi017.stderr: 17: (()+0x82de) [0x7fc8fd0e92de] 2020-06-27T04:25:47.579 INFO:tasks.ceph.osd.1.smithi017.stderr: 18: (clone()+0x43) [0x7fc8fbe93133] 2020-06-27T04:25:47.579 INFO:tasks.ceph.osd.1.smithi017.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:25:47.580 INFO:tasks.ceph.osd.1.smithi017.stderr: 2020-06-27T04:25:47.585 INFO:tasks.ceph.osd.1.smithi017.stderr: -1> 2020-06-27T04:25:47.555+0000 7fc8d4d78700 -1 *** Caught signal (Segmentation fault) ** 2020-06-27T04:25:47.585 INFO:tasks.ceph.osd.1.smithi017.stderr: in thread 7fc8d4d78700 thread_name:tp_osd_tp 2020-06-27T04:25:47.586 INFO:tasks.ceph.osd.1.smithi017.stderr: 2020-06-27T04:25:47.586 INFO:tasks.ceph.osd.1.smithi017.stderr: ceph version 16.0.0-2978-g77ddaecfcb0 (77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5) pacific (dev) 2020-06-27T04:25:47.586 INFO:tasks.ceph.osd.1.smithi017.stderr: 1: (()+0x12dc0) [0x7fc8fd0f3dc0] 2020-06-27T04:25:47.586 INFO:tasks.ceph.osd.1.smithi017.stderr: 2: (BlueStore::_do_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, std::set, std::allocator >*)+0x387) [0x55b1a6580707] 2020-06-27T04:25:47.586 INFO:tasks.ceph.osd.1.smithi017.stderr: 3: (BlueStore::_truncate(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long)+0x80) [0x55b1a6580aa0] 2020-06-27T04:25:47.587 INFO:tasks.ceph.osd.1.smithi017.stderr: 4: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1a4a) [0x55b1a65b267a] 2020-06-27T04:25:47.588 INFO:tasks.ceph.osd.1.smithi017.stderr: 5: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x317) [0x55b1a65b3a57] 2020-06-27T04:25:47.588 INFO:tasks.ceph.osd.1.smithi017.stderr: 6: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x55b1a623e938] 2020-06-27T04:25:47.588 INFO:tasks.ceph.osd.1.smithi017.stderr: 7: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0xc9d) [0x55b1a63ef03d] 2020-06-27T04:25:47.588 INFO:tasks.ceph.osd.1.smithi017.stderr: 8: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0xce0) [0x55b1a61ac5b0] 2020-06-27T04:25:47.588 INFO:tasks.ceph.osd.1.smithi017.stderr: 9: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x115d) [0x55b1a620589d] 2020-06-27T04:25:47.589 INFO:tasks.ceph.osd.1.smithi017.stderr: 10: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d80) [0x55b1a620e380] 2020-06-27T04:25:47.589 INFO:tasks.ceph.osd.1.smithi017.stderr: 11: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xd40) [0x55b1a6215590] 2020-06-27T04:25:47.589 INFO:tasks.ceph.osd.1.smithi017.stderr: 12: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x55b1a60954e9] 2020-06-27T04:25:47.589 INFO:tasks.ceph.osd.1.smithi017.stderr: 13: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x55b1a62f9f78] 2020-06-27T04:25:47.589 INFO:tasks.ceph.osd.1.smithi017.stderr: 14: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x55b1a60b470f] 2020-06-27T04:25:47.590 INFO:tasks.ceph.osd.1.smithi017.stderr: 15: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55b1a66f2b94] 2020-06-27T04:25:47.590 INFO:tasks.ceph.osd.1.smithi017.stderr: 16: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55b1a66f57f4] 2020-06-27T04:25:47.590 INFO:tasks.ceph.osd.1.smithi017.stderr: 17: (()+0x82de) [0x7fc8fd0e92de] 2020-06-27T04:25:47.590 INFO:tasks.ceph.osd.1.smithi017.stderr: 18: (clone()+0x43) [0x7fc8fbe93133] 2020-06-27T04:25:47.590 INFO:tasks.ceph.osd.1.smithi017.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-06-27T04:25:47.591 INFO:tasks.ceph.osd.1.smithi017.stderr: 2020-06-27T04:25:47.898 INFO:tasks.ceph.osd.1.smithi017.stderr:daemon-helper: command crashed with signal 11 2020-06-27T04:25:50.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2020-06-27T04:25:55.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~5s 2020-06-27T04:26:01.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~11s 2020-06-27T04:26:06.368 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~16s 2020-06-27T04:26:11.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:11.064+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:11.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~21s 2020-06-27T04:26:12.047 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:12.043+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:13.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:13.012+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:13.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:13.985+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:14.939 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:14.936+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:15.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:15.897+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:16.944 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:16.941+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:16.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~27s 2020-06-27T04:26:17.908 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:17.904+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:18.904 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:18.901+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:19.883 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:19.880+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:20.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:20.831+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:21.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:21.853+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:22.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~32s 2020-06-27T04:26:22.871 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:22.868+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:23.905 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:23.902+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:24.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:24.872+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:25.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:25.873+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:26.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:26.898+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:27.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~37s 2020-06-27T04:26:27.883 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:27.880+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:28.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:28.841+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:29.857 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:29.854+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:30.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:30.875+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:31.909 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:31.899+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:32.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~42s 2020-06-27T04:26:32.889 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:32.886+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:33.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:33.859+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:34.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:34.898+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:35.892 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:35.889+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:36.873 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:36.869+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:37.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:37.851+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:38.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~48s 2020-06-27T04:26:38.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:38.896+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:39.910 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:39.906+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:40.950 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:40.947+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:41.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:41.908+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:42.879 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:42.876+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:43.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2020-06-27T04:26:43.898 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:43.895+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:44.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:44.933+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:45.963 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:45.960+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:46.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:46.963+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:47.917 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:47.915+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:48.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~58s 2020-06-27T04:26:48.909 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:48.906+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:49.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:49.932+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:50.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:50.899+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:51.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:51.907+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:52.908 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:52.905+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:53.871 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:53.869+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:54.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~64s 2020-06-27T04:26:54.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:54.867+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:55.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:55.846+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:56.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:56.883+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:57.883 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:57.880+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:58.897 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:58.895+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:26:59.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~69s 2020-06-27T04:26:59.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:26:59.865+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:00.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:00.817+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:01.806 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:01.804+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:02.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:02.805+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:03.761 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:03.759+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:04.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~74s 2020-06-27T04:27:04.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:04.741+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:05.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:05.713+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:06.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:06.683+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:07.663 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:07.660+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:08.683 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:08.680+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:09.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:09.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:10.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~80s 2020-06-27T04:27:10.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:10.727+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:11.688 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:11.685+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:12.680 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:12.677+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:13.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:13.719+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:14.713 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:14.711+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:15.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~85s 2020-06-27T04:27:15.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:15.741+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:16.792 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:16.789+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:17.746 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:17.744+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:18.696 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:18.694+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:19.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:19.703+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:19.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:19.703+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:20.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~90s 2020-06-27T04:27:20.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:20.703+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:20.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:20.703+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:21.704 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:21.701+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:21.704 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:21.701+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:22.674 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:22.672+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:22.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:22.672+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:23.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:23.635+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:23.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:23.635+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:24.631 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:24.627+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:24.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:24.627+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:25.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:25.614+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:25.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:25.614+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:25.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~95s 2020-06-27T04:27:26.570 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:26.568+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:26.570 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:26.568+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:27.538 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:27.531+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:27.539 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:27.531+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:28.581 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:28.578+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:28.581 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:28.578+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:29.558 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:29.555+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:29.559 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:29.555+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:30.560 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:30.556+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:30.560 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:30.556+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:31.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~101s 2020-06-27T04:27:31.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:31.538+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:31.544 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:31.538+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:32.579 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:32.576+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:32.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:32.576+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:33.625 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:33.622+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:33.625 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:33.622+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:34.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:34.630+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:34.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:34.630+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:35.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:35.637+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:35.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:35.638+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:36.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~106s 2020-06-27T04:27:36.593 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:36.588+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:36.593 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:36.588+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:37.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:37.630+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:37.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:37.630+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:38.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:38.613+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:38.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:38.613+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:39.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:39.663+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:39.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:39.663+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:40.704 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:40.700+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:40.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:40.700+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:41.689 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:41.678+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:41.690 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:41.678+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:41.846 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2020-06-27T04:27:42.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:42.716+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:42.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:42.716+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:43.678 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:43.675+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:43.678 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:43.675+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:44.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:44.673+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:44.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:44.673+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:45.646 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:45.640+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:45.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:45.640+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:46.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:46.663+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:46.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:46.663+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:47.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2020-06-27T04:27:47.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:47.703+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:47.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:47.703+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:48.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:48.738+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:48.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:48.738+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:49.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:49.751+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:49.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:49.751+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:50.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:50.767+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:50.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:50.767+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:51.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:51.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:51.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:51.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:52.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~122s 2020-06-27T04:27:52.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:52.847+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:52.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:52.847+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:53.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:53.817+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:53.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:53.817+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:54.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:54.829+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:54.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:54.829+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:55.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:55.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:55.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:55.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:56.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:56.823+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:56.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:56.823+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:57.761 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~127s 2020-06-27T04:27:57.857 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:57.855+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:57.858 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:57.855+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:58.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:58.823+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:58.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:58.823+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:27:59.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:59.861+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:27:59.865 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:27:59.861+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:00.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:00.824+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:00.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:00.824+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:01.822 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:01.819+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:01.822 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:01.819+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:02.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:02.842+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:02.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:02.842+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:03.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~133s 2020-06-27T04:28:03.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:03.822+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:03.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:03.822+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:04.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:04.774+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:04.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:04.774+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:05.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:05.733+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:05.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:05.733+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:06.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:06.776+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:06.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:06.776+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:07.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:07.823+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:07.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:07.823+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:08.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~138s 2020-06-27T04:28:08.811 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:08.808+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:08.811 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:08.808+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:09.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:09.836+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:09.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:09.836+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:10.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:10.837+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:10.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:10.837+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:11.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:11.787+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:11.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:11.787+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:12.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:12.758+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:12.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:12.758+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:13.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~143s 2020-06-27T04:28:13.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:13.744+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:13.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:13.744+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:14.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:14.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:14.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:14.777+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:15.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:15.775+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:15.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:15.775+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:16.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:16.809+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:16.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:16.809+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:17.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:17.792+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:17.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:17.792+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:18.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:18.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:18.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:18.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:18.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~149s 2020-06-27T04:28:19.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:19.837+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:19.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:19.837+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:20.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:20.835+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:20.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:20.835+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:21.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:21.846+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:21.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:21.846+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:22.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:22.882+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:22.887 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:22.882+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:23.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:23.850+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:23.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:23.850+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:24.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~154s 2020-06-27T04:28:24.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:24.828+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:24.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:24.828+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:25.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:25.849+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:25.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:25.849+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:26.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:26.809+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:26.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:26.809+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:27.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:27.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:27.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:27.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:28.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:28.861+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:28.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:28.861+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:29.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~159s 2020-06-27T04:28:29.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:29.896+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:29.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:29.896+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:30.918 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:30.916+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:30.919 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:30.916+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:31.897 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:31.894+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:31.897 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:31.894+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:32.865 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:32.863+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:32.866 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:32.863+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:33.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:33.884+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:33.887 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:33.884+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:34.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:34.839+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:34.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:34.839+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:34.891 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~164s 2020-06-27T04:28:35.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:35.836+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:35.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:35.836+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:36.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:36.836+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:36.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:36.836+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:37.874 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:37.871+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:37.874 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:37.871+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:38.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:38.892+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:38.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:38.892+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:39.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:39.877+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:39.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:39.877+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:40.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~170s 2020-06-27T04:28:40.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:40.839+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:40.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:40.839+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:41.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:41.829+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:41.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:41.829+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:42.793 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:42.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:42.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:42.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:43.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:43.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:43.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:43.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:44.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:44.751+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:44.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:44.751+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:45.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~175s 2020-06-27T04:28:45.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:45.707+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:45.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:45.707+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:46.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:46.707+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:46.713 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:46.707+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:47.670 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:47.664+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:47.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:47.665+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:48.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:48.704+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:48.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:48.704+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:49.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:49.704+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:49.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:49.704+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:50.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:50.700+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:50.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:50.700+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:50.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~180s 2020-06-27T04:28:51.670 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:51.667+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:51.670 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:51.667+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:52.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:52.706+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:52.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:52.706+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:53.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:53.752+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:53.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:53.752+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:54.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:54.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:54.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:54.728+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:55.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:55.733+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:55.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:55.733+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:56.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~186s 2020-06-27T04:28:56.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:56.700+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:56.704 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:56.700+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:57.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:57.740+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:57.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:57.740+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:58.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:58.767+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:58.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:58.767+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:28:59.776 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:59.772+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:28:59.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:28:59.772+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:00.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:00.793+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:00.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:00.793+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:01.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~191s 2020-06-27T04:29:01.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:01.838+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:01.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:01.838+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:02.805 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:02.802+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:02.806 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:02.802+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:03.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:03.809+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:03.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:03.809+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:04.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:04.820+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:04.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:04.820+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:05.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:05.861+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:05.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:05.861+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:06.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~196s 2020-06-27T04:29:06.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:06.859+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:06.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:06.859+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:07.841 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:07.838+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:07.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:07.838+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:08.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:08.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:08.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:08.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:09.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:09.781+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:09.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:09.781+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:10.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:10.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:10.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:10.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:11.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:11.796+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:11.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:11.796+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:12.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~202s 2020-06-27T04:29:12.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:12.752+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:12.756 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:12.752+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:13.735 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:13.732+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:13.735 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:13.732+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:14.694 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:14.691+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:14.694 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:14.691+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:15.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:15.699+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:15.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:15.699+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:16.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:16.692+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:16.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:16.692+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:17.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~207s 2020-06-27T04:29:17.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:17.663+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:17.688 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:17.663+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:18.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:18.623+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:18.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:18.623+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:19.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:19.650+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:19.654 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:19.650+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:20.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:20.668+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:20.672 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:20.668+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:21.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:21.708+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:21.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:21.708+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:22.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~212s 2020-06-27T04:29:22.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:22.733+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:22.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:22.733+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:23.776 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:23.774+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:23.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:23.774+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:24.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:24.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:24.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:24.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:25.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:25.828+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:25.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:25.828+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:26.872 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:26.869+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:26.872 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:26.869+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:27.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:27.830+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:27.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:27.830+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:27.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~217s 2020-06-27T04:29:28.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:28.845+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:28.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:28.845+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:29.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:29.845+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:29.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:29.845+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:30.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:30.891+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:30.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:30.891+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:31.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:31.889+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:31.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:31.889+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:32.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:32.852+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:32.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:32.852+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:33.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~223s 2020-06-27T04:29:33.872 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:33.869+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:33.873 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:33.869+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:34.882 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:34.879+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:34.882 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:34.879+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:35.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:35.832+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:35.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:35.832+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:36.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:36.804+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:36.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:36.804+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:37.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:37.822+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:37.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:37.822+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:38.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~228s 2020-06-27T04:29:38.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:38.852+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:38.857 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:38.852+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:39.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:39.878+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:39.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:39.878+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:40.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:40.866+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:40.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:40.866+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:41.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:41.873+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:41.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:41.873+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:42.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:42.841+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:42.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:42.841+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:43.868 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~233s 2020-06-27T04:29:43.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:43.877+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:43.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:43.878+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:44.903 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:44.900+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:44.903 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:44.900+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:45.923 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:45.920+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:45.923 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:45.920+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:46.927 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:46.923+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:46.927 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:46.923+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:47.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:47.912+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:47.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:47.912+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:48.945 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:48.940+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:48.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:48.940+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:49.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~239s 2020-06-27T04:29:49.970 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:49.967+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:49.971 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:49.967+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:51.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:51.013+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:51.016 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:51.013+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:52.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:52.003+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:52.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:52.003+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:53.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:53.011+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:53.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:53.011+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:54.051 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:54.049+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:54.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:54.049+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:54.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~244s 2020-06-27T04:29:55.009 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:55.006+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:55.009 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:55.006+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:56.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:56.002+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:56.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:56.002+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:56.990 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:56.987+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:56.990 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:56.987+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:57.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:57.992+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:57.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:57.992+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:59.020 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:59.018+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:29:59.020 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:29:59.018+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:29:59.786 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~249s 2020-06-27T04:30:00.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:00.063+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:00.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:00.063+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:01.088 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:01.085+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:01.088 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:01.085+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:02.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:02.094+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:02.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:02.094+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:03.124 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:03.121+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:03.124 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:03.121+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:04.136 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:04.133+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:04.136 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:04.133+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:05.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~255s 2020-06-27T04:30:05.141 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:05.136+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:05.141 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:05.136+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:06.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:06.149+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:06.152 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:06.149+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:07.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:07.175+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:07.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:07.175+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:08.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:08.190+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:08.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:08.190+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:09.237 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:09.234+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:09.237 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:09.234+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:10.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:10.255+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:10.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:10.255+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:10.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~260s 2020-06-27T04:30:11.282 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:11.279+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:11.283 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:11.279+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:12.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:12.299+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:12.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:12.300+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:13.336 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:13.334+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:13.337 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:13.334+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:14.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:14.336+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:14.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:14.336+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:15.325 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:15.323+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:15.326 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:15.323+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:15.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~265s 2020-06-27T04:30:16.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:16.353+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:16.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:16.353+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:17.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:17.319+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:17.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:17.319+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:18.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:18.310+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:18.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:18.311+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:19.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:19.341+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:19.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:19.341+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:20.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:20.363+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:20.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:20.363+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:21.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~271s 2020-06-27T04:30:21.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:21.379+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:21.383 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:21.379+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:22.372 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:22.369+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:22.373 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:22.369+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:23.388 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:23.386+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:23.388 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:23.386+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:24.397 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:24.394+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:24.397 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:24.394+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:25.406 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:25.404+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:25.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:25.404+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:26.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~276s 2020-06-27T04:30:26.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:26.439+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:26.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:26.439+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:27.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:27.418+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:27.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:27.418+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:28.416 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:28.413+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:28.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:28.413+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:29.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:29.429+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:29.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:29.429+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:30.411 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:30.408+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:30.411 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:30.408+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:31.414 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:31.410+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:31.414 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:31.410+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:31.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~281s 2020-06-27T04:30:32.414 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:32.411+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:32.415 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:32.411+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:33.448 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:33.445+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:33.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:33.445+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:34.448 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:34.445+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:34.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:34.445+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:35.415 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:35.411+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:35.415 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:35.411+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:36.457 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:36.453+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:36.457 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:36.454+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:36.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~286s 2020-06-27T04:30:37.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:37.458+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:37.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:37.458+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:38.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:38.457+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:38.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:38.457+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:39.506 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:39.503+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:39.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:39.503+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:40.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:40.486+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:40.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:40.486+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:41.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:41.478+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:41.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:41.478+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:42.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~292s 2020-06-27T04:30:42.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:42.459+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:42.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:42.459+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:43.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:43.417+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:43.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:43.417+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:44.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:44.425+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:44.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:44.425+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:45.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:45.391+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:45.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:45.391+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:46.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:46.431+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:46.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:46.431+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:47.465 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:47.462+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:47.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:47.462+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:47.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~297s 2020-06-27T04:30:48.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:48.486+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:48.491 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:48.486+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:49.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:49.475+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:49.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:49.475+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:50.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:50.426+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:50.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:50.426+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:51.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:51.431+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:51.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:51.431+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:52.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:52.434+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:52.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:52.434+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:52.844 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~302s 2020-06-27T04:30:52.845 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2020-06-27T04:30:52.845 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-06-26-1211/qa/tasks/daemonwatchdog.py", line 37, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-06-26-1211/qa/tasks/daemonwatchdog.py", line 113, in watch self.bark() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-06-26-1211/qa/tasks/daemonwatchdog.py", line 53, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 254, in __getattr__ raise AttributeError(name) AttributeError: mounts 2020-06-27T04:30:53.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:53.399+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:53.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:53.399+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:54.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:54.449+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:54.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:54.449+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:55.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:55.404+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:55.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:55.404+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:56.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:56.397+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:56.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:56.397+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:57.395 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:57.392+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:57.395 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:57.392+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:58.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:58.434+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:58.438 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:58.434+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:30:59.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:59.464+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:30:59.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:30:59.464+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:00.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:00.436+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:00.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:00.436+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:01.414 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:01.410+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:01.414 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:01.410+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:02.374 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:02.371+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:02.374 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:02.371+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:03.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:03.414+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:03.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:03.414+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:04.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:04.432+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:04.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:04.432+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:05.456 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:05.452+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:05.456 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:05.452+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:06.465 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:06.462+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:06.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:06.462+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:07.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:07.490+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:07.494 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:07.490+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:08.448 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:08.445+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:08.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:08.445+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:09.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:09.431+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:09.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:09.431+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:10.428 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:10.424+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:10.428 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:10.425+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:11.395 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:11.392+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:11.395 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:11.392+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:12.409 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:12.407+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:12.410 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:12.407+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:13.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:13.451+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:13.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:13.451+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:14.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:14.475+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:14.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:14.475+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:15.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:15.511+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:15.515 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:15.511+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:16.487 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:16.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:16.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:16.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:17.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:17.505+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:17.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:17.505+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:18.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:18.502+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:18.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:18.502+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:19.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:19.474+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:19.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:19.474+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:20.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:20.472+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:20.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:20.472+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:21.522 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:21.519+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:21.522 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:21.519+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:22.517 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:22.513+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:22.518 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:22.514+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:23.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:23.526+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:23.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:23.526+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:24.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:24.565+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:24.568 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:24.565+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:25.569 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:25.566+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:25.570 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:25.566+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:26.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:26.615+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:26.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:26.615+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:27.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:27.659+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:27.662 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:27.659+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:28.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:28.708+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:28.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:28.708+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:29.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:29.690+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:29.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:29.690+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:30.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:30.700+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:30.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:30.700+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:31.715 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:31.712+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:31.715 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:31.712+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:32.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:32.752+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:32.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:32.752+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:33.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:33.764+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:33.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:33.764+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:34.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:34.739+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:34.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:34.739+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:35.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:35.751+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:35.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:35.751+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:36.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:36.741+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:36.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:36.741+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:37.696 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:37.694+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:37.697 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:37.694+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:38.691 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:38.689+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:38.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:38.689+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:39.683 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:39.681+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:39.684 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:39.681+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:40.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:40.703+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:40.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:40.703+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:41.746 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:41.737+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:41.746 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:41.737+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:42.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:42.703+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:42.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:42.703+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:43.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:43.739+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:43.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:43.739+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:44.734 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:44.732+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:44.735 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:44.732+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:45.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:45.711+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:45.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:45.711+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:46.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:46.735+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:46.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:46.736+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:47.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:47.708+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:47.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:47.708+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:48.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:48.705+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:48.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:48.705+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:49.677 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:49.675+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:49.677 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:49.675+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:50.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:50.630+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:50.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:50.630+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:51.591 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:51.589+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:51.592 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:51.589+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:52.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:52.552+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:52.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:52.552+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:53.556 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:53.553+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:53.556 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:53.553+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:54.575 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:54.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:54.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:54.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:55.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:55.619+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:55.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:55.619+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:56.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:56.630+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:56.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:56.630+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:57.602 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:57.598+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:57.603 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:57.598+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:58.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:58.633+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:58.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:58.634+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:31:59.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:59.585+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:31:59.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:31:59.585+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:00.549 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:00.546+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:00.550 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:00.546+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:01.512 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:01.509+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:01.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:01.509+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:02.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:02.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:02.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:02.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:03.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:03.445+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:03.450 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:03.445+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:04.432 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:04.429+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:04.432 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:04.429+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:05.415 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:05.412+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:05.416 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:05.412+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:06.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:06.439+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:06.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:06.439+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:07.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:07.421+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:07.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:07.421+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:08.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:08.459+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:08.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:08.459+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:09.427 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:09.424+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:09.428 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:09.424+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:10.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:10.457+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:10.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:10.457+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:11.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:11.420+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:11.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:11.420+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:12.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:12.381+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:12.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:12.381+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:13.431 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:13.426+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:13.432 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:13.426+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:14.447 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:14.443+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:14.448 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:14.443+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:15.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:15.451+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:15.455 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:15.451+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:16.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:16.491+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:16.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:16.491+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:17.542 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:17.539+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:17.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:17.539+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:18.506 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:18.494+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:18.506 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:18.494+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:19.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:19.478+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:19.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:19.478+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:20.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:20.433+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:20.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:20.433+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:21.411 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:21.408+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:21.411 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:21.408+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:22.456 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:22.453+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:22.456 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:22.453+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:23.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:23.404+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:23.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:23.404+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:24.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:24.382+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:24.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:24.382+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:25.370 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:25.367+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:25.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:25.367+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:26.376 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:26.373+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:26.377 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:26.373+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:27.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:27.416+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:27.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:27.416+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:28.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:28.458+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:28.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:28.458+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:29.455 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:29.453+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:29.456 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:29.453+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:30.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:30.446+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:30.450 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:30.446+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:31.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:31.413+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:31.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:31.413+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:32.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:32.421+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:32.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:32.421+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:33.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:33.437+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:33.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:33.437+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:34.432 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:34.430+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:34.433 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:34.430+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:35.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:35.420+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:35.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:35.420+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:36.414 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:36.411+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:36.415 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:36.411+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:37.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:37.460+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:37.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:37.460+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:38.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:38.478+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:38.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:38.478+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:39.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:39.496+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:39.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:39.496+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:40.544 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:40.541+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:40.545 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:40.541+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:41.523 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:41.520+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:41.524 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:41.520+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:42.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:42.563+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:42.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:42.563+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:43.591 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:43.588+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:43.592 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:43.588+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:44.578 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:44.575+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:44.578 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:44.575+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:45.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:45.605+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:45.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:45.605+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:46.649 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:46.646+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:46.649 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:46.646+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:47.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:47.684+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:47.688 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:47.684+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:48.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:48.727+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:48.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:48.727+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:49.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:49.688+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:49.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:49.688+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:50.735 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:50.732+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:50.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:50.732+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:51.783 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:51.780+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:51.783 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:51.780+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:52.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:52.822+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:52.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:52.822+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:53.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:53.859+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:53.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:53.859+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:54.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:54.843+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:54.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:54.843+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:55.841 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:55.838+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:55.841 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:55.838+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:56.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:56.825+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:56.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:56.825+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:57.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:57.786+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:57.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:57.786+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:58.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:58.745+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:58.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:58.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:32:59.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:59.763+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:32:59.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:32:59.763+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:00.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:00.735+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:00.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:00.735+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:01.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:01.700+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:01.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:01.700+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:02.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:02.733+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:02.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:02.734+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:03.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:03.774+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:03.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:03.774+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:04.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:04.760+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:04.763 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:04.760+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:05.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:05.724+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:05.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:05.724+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:06.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:06.755+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:06.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:06.756+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:07.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:07.769+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:07.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:07.769+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:08.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:08.725+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:08.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:08.725+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:09.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:09.765+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:09.768 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:09.765+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:10.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:10.771+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:10.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:10.772+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:11.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:11.782+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:11.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:11.782+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:12.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:12.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:12.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:12.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:13.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:13.767+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:13.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:13.767+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:14.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:14.789+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:14.792 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:14.789+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:15.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:15.749+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:15.752 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:15.749+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:16.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:16.712+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:16.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:16.712+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:17.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:17.760+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:17.763 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:17.760+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:18.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:18.806+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:18.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:18.806+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:19.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:19.816+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:19.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:19.816+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:20.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:20.841+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:20.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:20.841+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:21.804 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:21.802+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:21.804 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:21.802+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:22.841 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:22.839+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:22.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:22.839+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:23.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:23.822+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:23.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:23.822+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:24.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:24.851+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:24.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:24.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:25.843 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:25.841+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:25.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:25.841+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:26.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:26.888+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:26.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:26.888+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:27.890 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:27.887+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:27.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:27.887+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:28.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:28.858+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:28.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:28.858+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:29.841 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:29.837+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:29.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:29.837+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:30.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:30.817+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:30.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:30.817+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:31.871 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:31.863+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:31.871 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:31.864+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:32.885 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:32.882+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:32.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:32.882+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:33.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:33.875+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:33.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:33.875+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:34.898 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:34.895+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:34.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:34.895+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:35.938 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:35.935+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:35.938 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:35.935+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:36.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:36.927+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:36.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:36.927+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:37.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:37.891+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:37.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:37.891+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:38.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:38.845+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:38.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:38.845+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:39.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:39.825+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:39.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:39.825+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:40.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:40.860+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:40.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:40.860+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:41.883 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:41.880+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:41.883 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:41.880+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:42.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:42.847+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:42.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:42.847+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:43.866 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:43.862+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:43.867 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:43.862+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:44.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:44.821+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:44.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:44.821+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:45.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:45.779+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:45.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:45.779+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:46.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:46.775+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:46.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:46.775+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:47.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:47.823+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:47.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:47.823+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:48.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:48.853+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:48.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:48.853+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:49.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:49.891+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:49.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:49.891+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:50.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:50.859+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:50.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:50.859+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:51.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:51.866+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:51.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:51.866+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:52.887 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:52.882+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:52.888 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:52.882+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:53.924 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:53.920+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:53.925 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:53.920+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:54.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:54.932+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:54.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:54.932+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:55.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:55.948+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:55.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:55.948+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:57.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:56.988+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:57.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:56.988+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:58.032 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:58.029+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:58.032 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:58.029+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:59.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:59.001+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:59.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:59.001+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:33:59.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:59.964+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:33:59.967 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:33:59.964+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:00.926 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:00.922+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:00.927 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:00.922+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:01.879 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:01.876+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:01.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:01.876+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:02.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:02.908+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:02.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:02.908+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:03.913 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:03.910+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:03.914 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:03.910+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:04.867 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:04.862+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:04.868 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:04.862+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:05.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:05.842+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:05.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:05.842+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:06.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:06.860+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:06.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:06.860+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:07.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:07.820+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:07.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:07.820+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:08.860 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:08.858+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:08.861 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:08.858+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:09.907 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:09.904+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:09.907 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:09.904+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:10.914 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:10.911+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:10.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:10.911+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:11.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:11.899+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:11.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:11.899+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:12.923 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:12.919+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:12.923 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:12.919+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:13.906 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:13.903+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:13.906 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:13.903+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:14.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:14.896+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:14.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:14.896+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:15.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:15.890+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:15.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:15.890+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:16.920 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:16.906+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:16.921 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:16.906+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:17.866 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:17.864+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:17.867 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:17.864+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:18.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:18.848+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:18.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:18.848+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:19.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:19.846+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:19.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:19.846+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:20.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:20.825+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:20.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:20.825+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:21.837 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:21.833+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:21.837 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:21.833+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:22.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:22.795+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:22.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:22.795+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:23.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:23.833+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:23.843 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:23.833+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:24.806 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:24.800+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:24.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:24.800+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:25.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:25.798+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:25.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:25.798+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:26.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:26.776+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:26.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:26.776+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:27.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:27.785+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:27.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:27.785+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:28.795 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:28.792+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:28.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:28.792+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:29.804 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:29.800+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:29.805 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:29.800+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:30.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:30.753+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:30.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:30.753+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:31.806 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:31.795+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:31.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:31.795+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:32.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:32.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:32.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:32.778+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:33.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:33.735+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:33.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:33.735+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:34.701 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:34.699+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:34.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:34.699+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:35.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:35.653+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:35.656 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:35.653+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:36.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:36.685+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:36.688 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:36.685+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:37.737 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:37.734+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:37.737 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:37.734+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:38.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:38.713+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:38.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:38.713+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:39.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:39.681+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:39.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:39.681+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:40.684 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:40.682+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:40.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:40.682+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:41.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:41.684+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:41.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:41.684+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:42.680 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:42.678+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:42.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:42.678+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:43.659 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:43.657+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:43.660 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:43.657+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:44.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:44.640+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:44.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:44.640+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:45.629 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:45.627+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:45.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:45.627+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:46.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:46.669+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:46.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:46.669+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:47.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:47.641+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:47.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:47.641+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:48.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:48.631+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:48.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:48.631+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:49.646 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:49.643+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:49.646 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:49.643+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:50.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:50.661+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:50.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:50.661+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:51.677 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:51.675+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:51.677 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:51.675+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:52.658 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:52.655+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:52.658 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:52.655+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:53.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:53.685+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:53.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:53.685+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:54.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:54.715+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:54.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:54.715+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:55.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:55.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:55.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:55.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:56.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:56.726+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:56.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:56.726+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:57.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:57.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:57.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:57.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:58.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:58.785+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:58.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:58.785+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:34:59.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:59.784+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:34:59.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:34:59.784+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:00.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:00.745+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:00.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:00.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:01.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:01.759+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:01.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:01.759+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:02.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:02.799+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:02.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:02.799+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:03.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:03.750+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:03.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:03.750+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:04.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:04.740+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:04.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:04.740+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:05.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:05.725+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:05.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:05.725+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:06.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:06.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:06.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:06.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:07.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:07.804+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:07.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:07.804+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:08.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:08.776+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:08.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:08.776+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:09.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:09.797+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:09.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:09.797+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:10.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:10.836+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:10.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:10.836+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:11.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:11.833+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:11.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:11.833+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:12.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:12.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:12.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:12.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:13.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:13.772+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:13.776 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:13.772+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:14.763 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:14.760+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:14.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:14.760+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:15.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:15.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:15.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:15.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:16.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:16.797+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:16.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:16.797+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:17.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:17.822+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:17.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:17.822+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:18.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:18.839+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:18.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:18.839+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:19.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:19.849+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:19.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:19.849+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:20.872 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:20.868+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:20.872 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:20.868+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:21.909 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:21.905+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:21.909 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:21.905+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:22.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:22.926+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:22.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:22.926+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:23.952 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:23.949+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:23.952 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:23.949+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:24.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:24.981+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:24.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:24.981+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:25.992 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:25.989+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:25.992 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:25.989+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:27.009 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:27.006+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:27.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:27.006+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:28.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:28.052+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:28.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:28.052+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:29.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:29.035+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:29.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:29.035+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:30.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:30.001+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:30.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:30.001+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:30.999 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:30.996+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:31.000 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:30.996+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:31.962 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:31.959+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:31.962 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:31.959+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:32.992 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:32.989+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:32.992 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:32.989+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:34.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:34.023+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:34.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:34.023+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:35.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:35.068+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:35.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:35.068+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:36.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:36.043+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:36.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:36.043+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:37.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:37.055+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:37.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:37.055+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:38.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:38.092+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:38.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:38.092+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:39.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:39.101+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:39.105 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:39.101+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:40.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:40.063+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:40.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:40.063+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:41.084 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:41.082+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:41.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:41.082+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:42.133 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:42.130+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:42.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:42.130+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:43.173 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:43.170+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:43.174 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:43.170+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:44.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:44.148+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:44.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:44.148+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:45.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:45.137+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:45.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:45.137+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:46.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:46.097+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:46.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:46.098+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:47.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:47.099+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:47.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:47.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:48.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:48.076+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:48.079 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:48.076+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:49.095 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:49.092+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:49.095 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:49.092+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:50.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:50.069+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:50.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:50.069+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:51.035 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:51.032+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:51.035 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:51.032+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:52.045 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:52.043+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:52.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:52.043+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:53.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:53.011+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:53.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:53.011+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:54.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:54.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:54.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:54.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:54.992 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:54.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:54.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:54.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:56.020 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:56.018+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:56.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:56.018+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:57.020 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:57.017+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:57.020 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:57.017+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:57.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:57.975+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:57.978 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:57.975+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:35:58.986 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:58.984+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:35:58.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:35:58.984+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:00.031 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:00.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:00.031 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:00.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:01.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:01.000+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:01.003 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:01.000+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:02.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:02.032+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:02.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:02.033+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:03.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:03.083+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:03.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:03.083+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:04.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:04.118+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:04.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:04.119+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:05.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:05.118+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:05.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:05.118+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:06.119 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:06.117+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:06.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:06.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:07.152 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:07.150+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:07.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:07.150+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:08.177 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:08.175+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:08.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:08.175+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:09.128 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:09.126+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:09.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:09.126+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:10.124 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:10.122+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:10.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:10.122+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:11.109 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:11.107+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:11.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:11.107+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:12.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:12.130+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:12.133 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:12.130+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:13.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:13.162+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:13.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:13.163+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:14.122 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:14.120+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:14.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:14.120+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:15.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:15.071+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:15.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:15.072+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:16.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:16.060+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:16.063 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:16.060+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:17.063 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:17.060+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:17.063 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:17.060+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:18.032 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:18.030+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:18.032 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:18.030+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:19.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:19.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:19.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:19.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:20.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:20.069+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:20.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:20.069+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:21.056 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:21.053+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:21.056 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:21.053+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:22.079 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:22.077+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:22.080 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:22.077+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:23.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:23.069+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:23.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:23.069+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:24.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:24.021+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:24.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:24.021+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:25.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:25.066+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:25.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:25.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:26.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:26.099+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:26.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:26.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:27.119 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:27.116+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:27.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:27.116+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:28.136 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:28.133+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:28.137 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:28.133+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:29.146 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:29.143+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 since back 2020-06-27T04:25:46.736409+0000 front 2020-06-27T04:25:46.736462+0000 (oldest deadline 2020-06-27T04:26:10.236289+0000) 2020-06-27T04:36:29.146 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:29.143+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:30.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:30.122+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:31.160 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:31.157+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:32.149 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:32.146+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:33.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:33.137+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:34.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:34.107+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:35.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:35.084+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:36.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:36.045+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:37.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:37.038+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:38.025 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:38.022+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:39.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:39.062+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:40.095 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:40.092+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:41.131 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:41.127+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:42.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:42.094+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:43.133 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:43.130+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:44.168 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:44.165+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:45.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:45.153+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:46.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:46.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:47.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:47.132+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:48.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:48.105+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:49.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:49.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:50.056 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:50.053+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:51.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:51.087+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:36:51.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:51.087+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:52.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:52.064+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:36:52.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:52.064+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:53.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:53.108+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:36:53.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:53.108+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:54.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:54.073+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:36:54.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:54.073+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:55.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:55.117+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:36:55.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:55.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:56.147 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:56.145+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:36:56.148 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:56.145+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:57.160 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:57.158+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:36:57.161 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:57.158+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:58.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:58.150+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:36:58.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:58.150+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:36:59.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:59.107+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:36:59.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:36:59.107+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:00.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:00.072+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:00.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:00.072+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:01.094 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:01.091+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:01.095 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:01.091+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:02.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:02.072+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:02.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:02.072+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:03.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:03.099+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:03.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:03.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:04.143 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:04.140+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:04.144 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:04.140+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:05.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:05.117+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:05.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:05.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:06.147 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:06.144+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:06.148 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:06.144+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:07.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:07.115+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:07.119 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:07.115+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:08.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:08.137+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:08.141 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:08.137+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:09.154 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:09.151+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:09.154 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:09.151+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:10.184 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:10.181+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:10.184 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:10.181+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:11.180 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:11.178+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:11.181 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:11.178+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:12.143 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:12.140+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:12.143 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:12.140+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:13.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:13.098+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:13.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:13.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:14.109 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:14.105+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:14.109 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:14.106+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:15.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:15.107+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:15.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:15.107+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:16.130 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:16.126+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:16.130 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:16.126+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:17.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:17.161+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:17.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:17.162+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:18.198 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:18.196+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:18.199 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:18.196+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:19.211 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:19.206+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:19.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:19.206+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:20.184 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:20.180+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:20.184 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:20.180+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:21.172 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:21.169+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:21.172 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:21.169+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:22.199 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:22.196+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:22.199 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:22.196+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:23.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:23.211+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:23.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:23.211+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:24.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:24.215+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:24.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:24.215+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:25.198 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:25.195+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:25.198 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:25.195+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:26.159 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:26.157+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:26.160 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:26.157+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:27.116 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:27.113+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:27.116 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:27.113+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:28.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:28.098+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:28.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:28.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:29.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:29.050+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:29.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:29.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:30.088 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:30.085+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:30.088 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:30.086+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:31.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:31.067+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:31.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:31.067+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:32.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:32.076+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:32.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:32.076+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:33.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:33.060+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:33.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:33.060+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:34.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:34.059+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:34.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:34.059+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:35.049 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:35.045+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:35.049 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:35.045+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:36.037 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:36.034+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:36.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:36.034+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:37.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:37.066+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:37.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:37.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:38.119 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:38.116+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:38.119 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:38.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:39.163 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:39.161+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:39.164 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:39.161+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:40.200 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:40.198+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:40.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:40.198+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:41.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:41.222+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:41.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:41.222+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:42.267 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:42.264+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:42.267 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:42.264+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:43.308 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:43.306+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:43.309 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:43.306+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:44.311 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:44.309+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:44.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:44.309+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:45.292 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:45.290+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:45.293 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:45.290+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:46.338 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:46.335+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:46.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:46.335+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:47.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:47.321+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:47.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:47.321+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:48.370 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:48.368+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:48.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:48.368+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:49.364 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:49.362+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:49.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:49.362+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:50.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:50.356+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:50.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:50.356+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:51.396 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:51.393+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:51.396 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:51.394+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:52.415 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:52.412+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:52.415 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:52.412+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:53.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:53.417+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:53.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:53.418+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:54.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:54.378+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:54.383 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:54.378+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:55.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:55.421+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:55.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:55.421+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:56.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:56.457+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:56.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:56.457+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:57.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:57.455+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:57.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:57.455+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:58.457 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:58.454+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:58.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:58.454+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:37:59.504 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:59.501+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:37:59.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:37:59.501+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:00.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:00.472+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:00.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:00.472+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:01.451 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:01.448+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:01.451 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:01.448+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:02.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:02.442+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:02.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:02.442+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:03.416 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:03.413+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:03.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:03.413+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:04.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:04.381+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:04.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:04.381+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:05.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:05.405+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:05.409 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:05.405+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:06.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:06.386+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:06.391 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:06.386+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:07.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:07.387+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:07.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:07.387+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:08.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:08.346+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:08.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:08.346+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:09.320 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:09.317+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:09.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:09.317+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:10.287 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:10.284+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:10.288 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:10.284+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:11.294 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:11.290+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:11.294 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:11.290+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:12.285 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:12.282+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:12.285 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:12.282+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:13.262 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:13.259+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:13.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:13.259+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:14.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:14.244+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:14.248 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:14.244+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:15.271 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:15.267+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:15.272 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:15.267+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:16.284 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:16.281+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:16.285 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:16.281+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:17.260 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:17.257+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:17.261 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:17.257+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:18.298 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:18.295+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:18.299 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:18.295+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:19.304 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:19.301+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:19.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:19.301+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:20.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:20.278+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:20.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:20.278+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:21.232 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:21.229+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:21.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:21.229+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:22.232 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:22.229+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:22.232 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:22.229+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:23.276 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:23.273+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:23.276 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:23.273+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:24.300 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:24.298+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:24.301 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:24.298+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:25.338 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:25.335+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:25.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:25.335+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:26.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:26.368+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:26.372 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:26.368+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:27.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:27.397+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:27.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:27.397+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:28.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:28.438+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:28.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:28.438+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:29.412 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:29.409+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:29.413 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:29.409+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:30.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:30.439+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:30.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:30.439+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:31.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:31.450+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:31.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:31.450+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:32.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:32.481+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:32.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:32.481+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:33.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:33.459+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:33.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:33.459+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:34.497 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:34.495+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:34.498 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:34.495+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:35.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:35.449+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:35.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:35.449+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:36.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:36.457+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:36.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:36.457+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:37.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:37.477+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:37.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:37.477+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:38.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:38.456+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:38.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:38.456+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:39.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:39.431+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:39.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:39.431+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:40.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:40.432+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:40.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:40.432+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:41.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:41.431+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:41.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:41.431+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:42.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:42.477+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:42.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:42.477+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:43.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:43.440+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:43.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:43.440+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:44.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:44.398+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:44.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:44.398+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:45.352 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:45.348+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:45.352 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:45.348+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:46.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:46.320+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:46.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:46.320+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:47.368 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:47.366+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:47.369 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:47.366+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:48.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:48.362+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:48.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:48.362+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:49.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:49.329+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:49.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:49.330+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:50.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:50.309+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:50.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:50.309+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:51.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:51.327+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:51.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:51.327+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:52.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:52.310+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:52.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:52.310+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:53.279 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:53.276+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:53.279 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:53.276+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:54.282 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:54.280+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:54.282 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:54.280+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:55.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:55.233+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:55.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:55.233+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:56.230 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:56.228+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:56.231 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:56.228+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:57.264 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:57.262+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:57.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:57.262+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:58.294 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:58.292+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:58.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:58.292+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:38:59.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:59.260+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:38:59.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:38:59.260+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:00.234 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:00.232+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:00.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:00.232+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:01.226 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:01.224+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:01.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:01.224+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:02.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:02.222+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:02.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:02.223+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:03.186 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:03.184+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:03.187 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:03.184+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:04.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:04.233+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:04.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:04.233+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:05.202 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:05.200+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:05.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:05.200+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:06.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:06.234+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:06.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:06.234+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:07.286 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:07.283+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:07.286 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:07.283+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:08.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:08.279+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:08.282 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:08.279+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:09.277 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:09.274+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:09.277 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:09.274+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:10.294 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:10.292+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:10.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:10.292+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:11.318 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:11.315+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:11.318 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:11.315+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:12.318 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:12.316+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:12.319 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:12.316+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:13.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:13.354+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:13.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:13.354+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:14.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:14.354+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:14.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:14.354+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:15.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:15.313+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:15.316 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:15.313+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:16.311 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:16.309+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:16.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:16.309+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:17.329 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:17.327+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:17.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:17.327+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:18.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:18.319+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:18.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:18.319+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:19.331 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:19.329+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:19.331 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:19.329+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:20.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:20.355+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:20.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:20.355+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:21.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:21.346+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:21.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:21.346+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:22.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:22.346+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:22.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:22.346+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:23.363 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:23.361+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:23.364 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:23.361+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:24.397 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:24.395+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:24.397 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:24.395+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:25.377 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:25.375+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:25.378 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:25.375+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:26.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:26.414+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:26.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:26.414+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:27.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:27.456+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:27.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:27.456+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:28.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:28.473+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:28.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:28.473+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:29.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:29.446+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:29.450 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:29.446+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:30.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:30.466+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:30.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:30.466+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:31.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:31.425+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:31.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:31.425+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:32.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:32.418+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:32.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:32.418+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:33.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:33.432+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:33.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:33.432+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:34.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:34.443+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:34.447 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:34.443+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:35.403 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:35.400+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:35.403 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:35.400+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:36.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:36.443+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:36.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:36.443+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:37.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:37.437+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:37.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:37.437+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:38.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:38.420+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:38.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:38.420+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:39.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:39.466+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:39.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:39.466+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:40.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:40.425+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:40.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:40.425+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:41.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:41.446+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:41.450 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:41.446+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:42.451 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:42.448+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:42.451 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:42.448+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:43.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:43.496+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:43.500 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:43.496+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:44.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:44.458+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:44.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:44.458+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:45.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:45.475+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:45.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:45.475+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:46.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:46.432+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:46.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:46.432+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:47.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:47.478+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:47.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:47.478+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:48.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:48.502+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:48.506 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:48.502+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:49.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:49.499+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:49.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:49.499+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:50.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:50.533+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:50.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:50.533+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:51.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:51.499+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:51.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:51.499+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:52.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:52.505+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:52.509 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:52.505+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:53.549 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:53.545+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:53.549 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:53.545+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:54.594 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:54.591+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:54.594 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:54.591+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:55.638 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:55.635+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:55.639 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:55.635+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:56.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:56.664+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:56.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:56.664+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:57.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:57.683+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:57.686 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:57.683+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:58.698 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:58.695+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:58.698 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:58.695+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:39:59.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:59.708+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:39:59.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:39:59.708+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:00.674 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:00.671+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:00.674 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:00.671+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:01.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:01.661+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:01.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:01.661+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:02.629 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:02.625+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:02.629 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:02.625+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:03.657 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:03.646+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:03.657 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:03.646+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:04.665 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:04.661+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:04.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:04.661+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:05.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:05.619+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:05.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:05.619+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:06.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:06.601+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:06.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:06.601+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:07.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:07.564+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:07.568 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:07.564+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:08.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:08.551+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:08.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:08.551+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:09.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:09.523+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:09.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:09.523+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:10.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:10.519+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:10.522 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:10.519+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:11.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:11.474+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:11.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:11.474+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:12.483 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:12.481+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:12.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:12.481+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:13.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:13.465+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:13.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:13.465+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:14.483 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:14.480+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:14.483 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:14.480+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:15.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:15.457+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:15.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:15.457+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:16.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:16.439+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:16.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:16.439+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:17.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:17.417+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:17.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:17.417+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:18.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:18.466+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:18.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:18.466+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:19.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:19.461+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:19.465 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:19.461+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:20.504 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:20.501+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:20.504 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:20.501+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:21.537 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:21.534+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:21.540 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:21.534+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:22.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:22.553+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:22.556 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:22.553+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:23.602 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:23.599+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:23.602 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:23.599+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:24.575 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:24.571+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:24.575 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:24.571+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:25.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:25.534+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:25.537 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:25.534+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:26.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:26.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:26.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:26.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:27.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:27.483+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:27.486 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:27.483+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:28.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:28.496+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:28.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:28.496+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:29.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:29.524+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:29.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:29.524+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:30.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:30.492+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:30.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:30.493+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:31.531 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:31.529+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:31.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:31.529+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:32.538 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:32.535+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:32.538 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:32.536+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:33.546 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:33.544+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:33.546 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:33.544+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:34.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:34.540+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:34.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:34.540+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:35.533 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:35.531+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:35.533 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:35.531+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:36.561 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:36.559+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:36.562 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:36.559+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:37.553 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:37.551+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:37.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:37.551+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:38.549 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:38.546+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:38.549 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:38.546+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:39.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:39.511+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:39.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:39.511+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:40.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:40.533+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:40.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:40.533+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:41.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:41.564+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:41.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:41.564+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:42.611 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:42.609+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:42.612 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:42.609+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:43.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:43.606+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:43.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:43.606+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:44.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:44.629+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:44.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:44.629+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:45.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:45.633+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:45.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:45.633+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:46.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:46.646+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:46.649 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:46.646+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:47.691 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:47.689+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:47.691 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:47.689+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:48.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:48.653+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:48.656 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:48.653+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:49.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:49.616+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:49.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:49.616+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:50.595 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:50.592+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:50.595 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:50.592+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:51.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:51.642+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:51.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:51.642+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:52.600 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:52.598+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:52.601 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:52.598+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:53.594 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:53.591+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:53.594 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:53.591+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:54.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:54.637+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:54.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:54.637+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:55.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:55.638+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:55.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:55.638+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:56.689 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:56.686+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:56.689 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:56.686+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:57.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:57.644+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:57.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:57.644+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:58.694 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:58.691+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:58.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:58.691+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:40:59.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:59.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:40:59.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:40:59.728+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:00.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:00.714+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:00.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:00.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:01.688 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:01.685+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:01.688 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:01.685+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:02.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:02.690+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:02.694 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:02.690+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:03.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:03.645+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:03.649 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:03.645+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:04.619 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:04.616+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:04.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:04.616+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:05.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:05.610+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:05.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:05.610+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:06.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:06.605+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:06.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:06.606+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:07.658 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:07.655+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:07.658 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:07.655+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:08.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:08.672+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:08.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:08.672+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:09.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:09.702+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:09.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:09.702+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:10.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:10.713+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:10.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:10.713+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:11.672 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:11.669+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:11.672 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:11.669+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:12.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:12.641+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:12.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:12.641+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:13.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:13.639+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:13.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:13.639+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:14.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:14.688+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:14.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:14.688+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:15.663 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:15.660+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:15.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:15.660+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:16.690 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:16.687+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:16.690 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:16.687+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:17.734 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:17.731+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:17.734 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:17.731+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:18.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:18.704+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:18.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:18.704+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:19.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:19.672+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:19.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:19.672+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:20.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:20.634+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:20.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:20.634+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:21.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:21.618+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:21.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:21.618+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:22.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:22.649+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:22.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:22.649+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:23.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:23.658+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:23.662 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:23.658+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:24.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:24.625+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:24.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:24.625+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:25.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:25.658+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:25.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:25.658+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:26.619 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:26.616+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:26.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:26.616+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:27.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:27.624+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:27.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:27.624+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:28.583 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:28.580+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:28.583 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:28.580+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:29.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:29.613+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:29.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:29.613+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:30.611 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:30.608+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:30.611 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:30.608+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:31.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:31.619+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:31.623 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:31.619+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:32.654 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:32.651+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:32.654 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:32.651+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:33.699 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:33.696+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:33.699 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:33.696+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:34.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:34.689+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:34.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:34.689+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:35.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:35.644+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:35.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:35.644+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:36.689 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:36.686+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:36.690 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:36.686+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:37.679 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:37.677+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:37.680 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:37.677+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:38.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:38.725+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:38.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:38.725+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:39.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:39.714+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:39.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:39.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:40.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:40.677+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:40.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:40.677+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:41.700 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:41.698+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:41.701 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:41.698+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:42.669 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:42.666+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:42.669 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:42.666+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:43.684 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:43.682+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:43.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:43.682+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:44.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:44.638+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:44.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:44.638+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:45.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:45.677+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:45.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:45.677+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:46.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:46.638+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:46.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:46.638+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:47.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:47.617+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:47.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:47.617+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:48.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:48.604+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:48.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:48.604+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:49.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:49.614+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:49.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:49.614+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:50.581 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:50.578+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:50.581 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:50.578+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:51.531 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:51.529+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:51.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:51.529+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:52.573 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:52.571+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:52.574 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:52.571+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:53.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:53.551+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:53.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:53.551+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:54.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:54.544+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:54.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:54.544+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:55.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:55.560+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:55.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:55.560+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:56.530 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:56.528+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:56.531 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:56.528+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:57.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:57.527+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:57.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:57.527+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:58.525 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:58.522+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:58.525 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:58.523+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:41:59.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:59.493+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:41:59.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:41:59.493+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:00.483 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:00.481+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:00.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:00.481+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:01.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:01.490+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:01.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:01.491+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:02.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:02.461+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:02.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:02.461+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:03.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:03.442+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:03.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:03.443+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:04.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:04.419+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:04.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:04.419+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:05.397 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:05.394+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:05.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:05.395+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:06.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:06.419+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:06.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:06.419+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:07.457 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:07.455+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:07.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:07.455+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:08.413 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:08.411+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:08.414 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:08.411+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:09.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:09.399+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:09.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:09.399+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:10.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:10.421+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:10.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:10.422+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:11.444 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:11.441+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:11.444 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:11.441+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:12.433 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:12.431+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:12.433 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:12.431+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:13.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:13.451+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:13.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:13.451+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:14.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:14.418+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:14.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:14.418+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:15.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:15.439+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:15.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:15.439+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:16.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:16.476+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:16.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:16.476+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:17.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:17.433+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:17.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:17.433+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:18.433 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:18.430+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:18.433 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:18.430+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:19.391 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:19.389+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:19.392 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:19.389+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:20.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:20.422+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:20.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:20.422+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:21.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:21.440+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:21.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:21.440+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:22.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:22.461+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:22.465 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:22.461+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:23.512 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:23.509+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:23.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:23.509+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:24.533 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:24.530+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:24.533 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:24.530+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:25.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:25.489+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:25.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:25.489+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:26.509 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:26.506+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:26.509 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:26.506+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:27.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:27.551+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:27.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:27.551+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:28.559 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:28.556+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:28.559 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:28.556+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:29.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:29.529+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:29.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:29.529+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:30.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:30.529+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:30.533 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:30.529+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:31.562 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:31.559+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:31.562 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:31.559+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:32.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:32.594+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:32.598 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:32.594+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:33.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:33.606+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:33.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:33.606+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:34.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:34.593+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:34.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:34.594+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:35.639 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:35.636+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:35.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:35.636+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:36.654 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:36.651+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:36.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:36.651+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:37.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:37.615+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:37.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:37.615+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:38.619 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:38.616+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:38.619 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:38.616+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:39.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:39.603+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:39.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:39.603+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:40.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:40.601+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:40.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:40.601+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:41.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:41.552+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:41.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:41.552+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:42.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:42.594+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:42.598 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:42.594+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:43.623 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:43.620+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:43.624 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:43.620+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:44.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:44.601+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:44.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:44.601+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:45.613 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:45.611+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:45.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:45.611+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:46.619 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:46.616+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:46.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:46.616+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:47.657 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:47.654+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:47.657 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:47.654+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:48.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:48.622+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:48.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:48.622+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:49.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:49.628+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:49.631 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:49.628+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:50.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:50.642+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:50.646 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:50.642+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:51.660 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:51.657+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:51.660 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:51.657+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:52.686 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:52.683+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:52.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:52.683+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:53.669 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:53.665+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:53.669 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:53.666+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:54.715 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:54.713+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:54.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:54.713+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:55.735 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:55.733+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:55.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:55.733+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:56.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:56.779+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:56.783 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:56.779+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:57.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:57.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:57.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:57.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:58.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:58.809+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:58.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:58.809+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:42:59.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:59.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:42:59.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:42:59.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:00.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:00.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:00.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:00.728+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:01.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:01.752+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:01.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:01.752+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:02.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:02.714+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:02.718 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:02.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:03.686 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:03.683+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:03.686 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:03.683+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:04.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:04.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:04.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:04.729+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:05.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:05.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:05.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:05.777+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:06.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:06.779+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:06.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:06.779+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:07.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:07.749+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:07.752 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:07.749+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:08.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:08.785+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:08.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:08.785+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:09.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:09.830+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:09.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:09.830+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:10.822 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:10.819+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:10.822 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:10.819+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:11.872 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:11.870+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:11.873 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:11.870+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:12.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:12.841+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:12.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:12.841+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:13.874 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:13.872+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:13.875 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:13.872+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:14.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:14.833+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:14.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:14.833+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:15.843 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:15.841+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:15.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:15.841+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:16.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:16.868+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:16.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:16.868+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:17.918 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:17.916+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:17.919 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:17.916+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:18.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:18.930+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:18.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:18.930+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:19.919 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:19.916+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:19.919 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:19.916+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:20.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:20.876+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:20.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:20.876+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:21.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:21.841+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:21.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:21.841+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:22.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:22.875+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:22.879 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:22.875+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:23.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:23.829+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:23.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:23.829+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:24.865 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:24.863+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:24.865 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:24.863+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:25.818 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:25.815+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:25.818 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:25.815+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:26.829 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:26.821+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:26.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:26.821+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:27.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:27.789+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:27.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:27.789+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:28.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:28.775+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:28.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:28.775+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:29.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:29.776+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:29.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:29.776+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:30.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:30.762+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:30.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:30.762+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:31.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:31.714+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:31.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:31.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:32.704 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:32.701+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:32.704 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:32.702+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:33.679 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:33.676+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:33.679 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:33.676+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:34.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:34.672+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:34.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:34.672+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:35.725 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:35.719+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:35.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:35.719+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:36.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:36.762+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:36.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:36.762+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:37.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:37.752+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:37.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:37.752+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:38.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:38.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:38.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:38.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:39.792 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:39.790+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:39.792 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:39.790+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:40.793 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:40.790+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:40.793 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:40.790+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:41.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:41.818+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:41.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:41.818+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:42.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:42.798+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:42.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:42.798+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:43.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:43.756+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:43.759 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:43.756+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:44.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:44.765+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:44.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:44.765+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:45.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:45.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:45.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:45.728+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:46.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:46.738+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:46.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:46.738+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:47.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:47.760+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:47.763 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:47.760+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:48.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:48.714+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:48.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:48.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:49.679 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:49.676+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:49.679 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:49.676+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:50.665 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:50.662+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:50.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:50.662+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:51.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:51.682+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:51.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:51.682+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:52.715 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:52.713+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:52.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:52.713+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:53.763 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:53.760+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:53.763 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:53.760+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:54.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:54.787+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:54.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:54.787+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:55.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:55.795+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:55.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:55.795+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:56.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:56.828+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:56.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:56.829+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:57.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:57.807+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:57.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:57.807+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:58.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:58.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:58.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:58.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:43:59.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:59.784+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:43:59.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:43:59.784+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:00.760 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:00.757+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:00.760 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:00.757+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:01.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:01.769+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:01.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:01.769+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:02.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:02.762+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:02.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:02.762+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:03.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:03.729+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:03.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:03.729+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:04.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:04.712+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:04.715 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:04.712+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:05.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:05.684+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:05.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:05.684+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:06.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:06.702+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:06.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:06.702+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:07.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:07.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:07.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:07.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:08.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:08.752+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:08.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:08.752+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:09.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:09.755+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:09.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:09.755+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:10.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:10.752+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:10.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:10.752+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:11.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:11.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:11.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:11.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:12.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:12.725+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:12.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:12.725+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:13.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:13.703+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:13.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:13.703+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:14.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:14.738+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:14.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:14.738+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:15.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:15.727+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:15.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:15.727+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:16.745 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:16.742+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:16.746 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:16.742+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:17.718 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:17.715+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:17.718 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:17.715+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:18.715 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:18.712+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:18.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:18.712+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:19.725 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:19.722+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:19.725 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:19.722+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:20.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:20.755+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:20.759 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:20.755+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:21.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:21.763+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:21.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:21.763+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:22.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:22.798+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:22.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:22.798+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:23.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:23.819+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:23.822 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:23.819+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:24.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:24.797+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:24.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:24.797+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:25.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:25.818+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:25.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:25.818+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:26.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:26.806+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:26.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:26.806+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:27.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:27.781+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:27.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:27.781+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:28.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:28.735+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:28.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:28.735+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:29.769 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:29.767+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:29.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:29.767+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:30.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:30.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:30.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:30.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:31.763 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:31.760+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:31.763 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:31.760+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:32.734 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:32.732+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:32.735 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:32.732+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:33.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:33.765+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:33.768 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:33.765+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:34.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:34.785+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:34.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:34.785+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:35.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:35.796+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:35.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:35.796+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:36.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:36.797+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:36.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:36.797+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:37.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:37.776+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:37.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:37.776+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:38.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:38.750+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:38.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:38.750+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:39.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:39.765+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:39.768 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:39.765+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:40.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:40.734+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:40.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:40.734+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:41.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:41.711+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:41.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:41.711+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:42.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:42.718+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:42.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:42.718+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:43.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:43.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:43.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:43.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:44.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:44.745+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:44.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:44.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:45.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:45.786+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:45.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:45.787+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:46.817 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:46.813+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:46.817 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:46.813+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:47.843 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:47.840+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:47.843 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:47.840+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:48.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:48.816+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:48.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:48.816+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:49.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:49.818+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:49.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:49.818+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:50.792 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:50.789+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:50.792 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:50.789+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:51.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:51.819+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:51.822 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:51.819+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:52.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:52.854+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:52.857 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:52.854+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:53.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:53.852+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:53.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:53.852+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:54.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:54.851+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:54.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:54.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:55.874 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:55.872+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:55.875 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:55.872+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:56.868 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:56.866+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:56.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:56.866+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:57.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:57.830+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:57.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:57.831+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:58.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:58.844+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:58.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:58.844+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:44:59.892 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:59.889+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:44:59.892 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:44:59.890+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:00.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:00.845+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:00.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:00.846+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:01.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:01.833+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:01.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:01.833+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:02.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:02.844+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:02.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:02.844+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:03.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:03.828+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:03.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:03.828+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:04.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:04.813+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:04.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:04.814+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:05.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:05.801+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:05.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:05.801+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:06.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:06.810+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:06.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:06.810+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:07.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:07.783+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:07.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:07.784+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:08.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:08.738+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:08.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:08.738+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:09.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:09.738+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:09.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:09.738+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:10.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:10.785+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:10.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:10.785+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:11.763 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:11.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:11.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:11.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:12.752 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:12.750+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:12.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:12.750+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:13.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:13.760+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:13.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:13.760+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:14.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:14.808+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:14.811 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:14.808+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:15.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:15.810+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:15.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:15.810+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:16.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:16.820+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:16.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:16.820+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:17.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:17.794+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:17.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:17.794+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:18.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:18.842+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:18.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:18.842+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:19.841 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:19.838+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:19.841 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:19.838+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:20.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:20.827+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:20.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:20.827+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:21.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:21.846+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:21.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:21.846+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:22.892 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:22.889+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:22.892 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:22.889+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:23.928 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:23.925+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:23.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:23.925+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:24.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:24.888+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:24.892 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:24.888+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:25.843 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:25.840+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:25.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:25.840+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:26.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:26.843+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:26.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:26.843+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:27.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:27.839+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:27.843 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:27.839+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:28.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:28.841+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:28.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:28.842+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:29.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:29.845+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:29.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:29.845+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:30.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:30.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:30.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:30.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:31.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:31.804+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:31.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:31.804+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:32.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:32.816+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:32.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:32.816+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:33.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:33.807+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:33.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:33.807+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:34.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:34.823+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:34.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:34.823+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:35.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:35.839+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:35.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:35.839+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:36.860 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:36.857+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:36.860 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:36.857+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:37.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:37.860+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:37.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:37.860+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:38.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:38.823+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:38.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:38.823+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:39.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:39.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:39.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:39.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:40.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:40.788+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:40.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:40.788+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:41.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:41.746+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:41.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:41.746+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:42.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:42.748+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:42.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:42.748+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:43.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:43.729+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:43.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:43.729+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:44.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:44.717+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:44.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:44.717+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:45.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:45.678+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:45.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:45.678+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:46.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:46.714+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:46.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:46.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:47.761 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:47.758+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:47.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:47.758+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:48.761 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:48.758+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:48.761 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:48.758+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:49.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:49.754+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:49.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:49.754+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:50.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:50.707+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:50.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:50.707+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:51.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:51.672+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:51.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:51.672+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:52.725 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:52.722+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:52.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:52.722+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:53.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:53.740+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:53.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:53.740+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:54.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:54.767+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:54.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:54.767+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:55.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:55.787+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:55.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:55.787+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:56.795 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:56.793+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:56.795 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:56.793+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:57.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:57.786+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:57.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:57.786+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:58.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:58.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:58.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:58.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:45:59.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:59.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:45:59.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:45:59.728+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:00.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:00.731+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:00.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:00.731+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:01.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:01.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:01.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:01.777+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:02.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:02.755+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:02.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:02.755+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:03.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:03.794+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:03.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:03.794+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:04.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:04.810+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:04.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:04.810+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:05.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:05.813+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:05.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:05.813+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:06.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:06.775+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:06.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:06.775+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:07.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:07.726+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:07.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:07.726+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:08.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:08.718+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:08.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:08.718+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:09.674 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:09.672+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:09.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:09.672+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:10.694 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:10.691+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:10.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:10.691+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:11.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:11.736+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:11.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:11.736+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:12.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:12.700+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:12.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:12.700+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:13.663 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:13.661+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:13.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:13.661+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:14.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:14.673+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:14.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:14.673+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:15.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:15.667+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:15.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:15.667+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:16.680 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:16.678+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:16.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:16.678+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:17.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:17.714+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:17.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:17.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:18.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:18.720+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:18.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:18.720+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:19.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:19.748+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:19.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:19.748+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:20.713 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:20.711+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:20.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:20.711+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:21.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:21.730+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:21.733 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:21.730+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:22.760 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:22.758+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:22.761 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:22.758+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:23.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:23.764+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:23.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:23.764+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:24.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:24.746+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:24.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:24.746+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:25.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:25.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:25.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:25.777+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:26.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:26.737+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:26.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:26.737+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:27.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:27.764+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:27.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:27.764+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:28.803 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:28.801+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:28.804 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:28.801+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:29.776 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:29.774+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:29.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:29.774+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:30.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:30.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:30.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:30.777+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:31.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:31.729+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:31.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:31.729+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:32.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:32.683+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:32.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:32.683+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:33.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:33.639+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:33.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:33.639+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:34.650 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:34.648+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:34.651 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:34.648+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:35.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:35.669+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:35.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:35.669+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:36.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:36.708+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:36.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:36.708+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:37.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:37.707+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:37.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:37.707+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:38.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:38.665+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:38.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:38.665+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:39.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:39.653+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:39.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:39.653+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:40.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:40.658+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:40.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:40.658+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:41.663 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:41.661+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:41.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:41.661+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:42.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:42.685+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:42.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:42.685+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:43.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:43.664+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:43.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:43.664+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:44.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:44.706+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:44.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:44.706+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:45.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:45.661+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:45.665 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:45.661+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:46.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:46.629+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:46.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:46.629+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:47.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:47.623+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:47.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:47.623+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:48.629 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:48.626+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:48.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:48.626+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:49.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:49.614+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:49.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:49.614+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:50.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:50.602+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:50.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:50.602+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:51.592 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:51.589+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:51.593 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:51.589+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:52.629 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:52.626+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:52.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:52.626+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:53.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:53.644+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:53.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:53.644+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:54.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:54.603+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:54.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:54.603+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:55.625 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:55.622+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:55.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:55.622+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:56.579 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:56.576+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:56.579 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:56.576+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:57.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:57.624+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:57.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:57.624+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:58.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:58.623+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:58.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:58.623+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:46:59.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:59.641+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:46:59.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:46:59.641+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:00.624 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:00.621+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:47:00.625 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:00.621+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:01.598 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:01.595+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:47:01.598 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:01.595+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:02.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:02.592+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:47:02.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:02.592+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:03.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:03.625+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:47:03.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:03.625+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:04.657 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:04.654+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:36:30.800691+0000 (oldest deadline 2020-06-27T04:36:50.800691+0000) 2020-06-27T04:47:04.658 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:04.654+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:05.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:05.689+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:06.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:06.709+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:07.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:07.717+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:08.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:08.738+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:09.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:09.739+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:10.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:10.739+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:11.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:11.707+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:12.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:12.744+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:13.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:13.781+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:14.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:14.814+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:15.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:15.845+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:16.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:16.798+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:17.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:17.827+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:18.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:18.795+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:19.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:19.845+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:20.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:20.858+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:21.890 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:21.888+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:22.912 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:22.909+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:23.950 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:23.948+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:24.905 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:24.902+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:25.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:25.948+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:26.960 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:26.957+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:27.921 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:27.918+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:28.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:28.931+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:28.936 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:28.931+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:29.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:29.938+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:29.941 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:29.938+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:30.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:30.892+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:30.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:30.892+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:31.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:31.926+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:31.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:31.926+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:32.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:32.963+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:32.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:32.963+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:34.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:34.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:34.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:34.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:34.978 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:34.975+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:34.978 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:34.975+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:35.960 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:35.957+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:35.960 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:35.957+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:36.936 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:36.933+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:36.936 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:36.933+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:37.889 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:37.887+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:37.889 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:37.887+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:38.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:38.842+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:38.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:38.842+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:39.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:39.822+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:39.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:39.822+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:40.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:40.828+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:40.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:40.828+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:41.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:41.829+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:41.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:41.829+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:42.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:42.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:42.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:42.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:43.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:43.767+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:43.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:43.767+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:44.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:44.760+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:44.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:44.760+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:45.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:45.737+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:45.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:45.737+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:46.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:46.711+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:46.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:46.711+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:47.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:47.679+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:47.682 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:47.679+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:48.680 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:48.678+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:48.680 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:48.678+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:49.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:49.718+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:49.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:49.718+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:50.696 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:50.692+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:50.696 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:50.692+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:51.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:51.739+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:51.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:51.739+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:52.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:52.780+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:52.783 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:52.780+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:53.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:53.818+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:53.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:53.818+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:54.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:54.837+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:54.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:54.837+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:55.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:55.847+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:55.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:55.847+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:56.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:56.826+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:56.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:56.826+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:57.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:57.780+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:57.783 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:57.780+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:58.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:58.740+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:58.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:58.740+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:47:59.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:59.727+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:47:59.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:47:59.727+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:00.704 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:00.701+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:00.704 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:00.701+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:01.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:01.703+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:01.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:01.703+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:02.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:02.700+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:02.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:02.700+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:03.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:03.658+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:03.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:03.658+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:04.651 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:04.649+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:04.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:04.649+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:05.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:05.639+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:05.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:05.639+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:06.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:06.618+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:06.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:06.618+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:07.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:07.642+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:07.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:07.642+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:08.631 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:08.627+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:08.631 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:08.627+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:09.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:09.630+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:09.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:09.630+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:10.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:10.669+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:10.672 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:10.669+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:11.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:11.673+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:11.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:11.673+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:12.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:12.633+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:12.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:12.633+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:13.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:13.594+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:13.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:13.594+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:14.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:14.644+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:14.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:14.644+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:15.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:15.684+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:15.688 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:15.684+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:16.650 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:16.647+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:16.650 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:16.647+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:17.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:17.641+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:17.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:17.641+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:18.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:18.613+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:18.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:18.613+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:19.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:19.645+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:19.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:19.645+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:20.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:20.629+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:20.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:20.629+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:21.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:21.617+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:21.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:21.617+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:22.624 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:22.621+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:22.625 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:22.621+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:23.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:23.650+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:23.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:23.650+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:24.700 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:24.698+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:24.701 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:24.698+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:25.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:25.705+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:25.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:25.705+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:26.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:26.665+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:26.669 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:26.665+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:27.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:27.709+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:27.713 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:27.709+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:28.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:28.726+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:28.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:28.726+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:29.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:29.771+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:29.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:29.771+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:30.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:30.771+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:30.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:30.771+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:31.783 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:31.780+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:31.783 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:31.780+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:32.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:32.744+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:32.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:32.744+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:33.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:33.723+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:33.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:33.723+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:34.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:34.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:34.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:34.728+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:35.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:35.692+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:35.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:35.692+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:36.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:36.725+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:36.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:36.725+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:37.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:37.714+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:37.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:37.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:38.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:38.729+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:38.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:38.729+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:39.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:39.714+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:39.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:39.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:40.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:40.705+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:40.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:40.705+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:41.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:41.719+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:41.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:41.719+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:42.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:42.670+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:42.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:42.670+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:43.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:43.632+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:43.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:43.632+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:44.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:44.625+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:44.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:44.625+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:45.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:45.602+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:45.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:45.602+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:46.600 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:46.598+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:46.601 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:46.598+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:47.646 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:47.643+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:47.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:47.643+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:48.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:48.633+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:48.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:48.633+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:49.659 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:49.656+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:49.660 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:49.656+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:50.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:50.613+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:50.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:50.613+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:51.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:51.638+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:51.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:51.638+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:52.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:52.630+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:52.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:52.630+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:53.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:53.641+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:53.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:53.641+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:54.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:54.635+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:54.638 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:54.635+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:55.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:55.625+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:55.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:55.625+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:56.592 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:56.590+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:56.593 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:56.590+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:57.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:57.625+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:57.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:57.625+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:58.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:58.638+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:58.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:58.638+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:48:59.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:59.594+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:48:59.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:48:59.594+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:00.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:00.604+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:00.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:00.604+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:01.603 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:01.600+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:01.603 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:01.600+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:02.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:02.560+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:02.564 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:02.560+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:03.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:03.574+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:03.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:03.574+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:04.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:04.577+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:04.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:04.577+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:05.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:05.532+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:05.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:05.532+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:06.530 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:06.528+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:06.530 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:06.528+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:07.497 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:07.495+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:07.498 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:07.495+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:08.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:08.475+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:08.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:08.475+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:09.518 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:09.515+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:09.518 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:09.515+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:10.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:10.509+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:10.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:10.509+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:11.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:11.510+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:11.515 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:11.510+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:12.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:12.512+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:12.515 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:12.512+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:13.518 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:13.516+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:13.519 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:13.516+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:14.530 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:14.528+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:14.531 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:14.528+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:15.575 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:15.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:15.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:15.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:16.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:16.552+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:16.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:16.553+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:17.506 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:17.503+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:17.506 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:17.503+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:18.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:18.527+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:18.530 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:18.527+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:19.486 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:19.484+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:19.487 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:19.484+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:20.451 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:20.449+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:20.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:20.449+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:21.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:21.458+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:21.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:21.458+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:22.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:22.476+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:22.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:22.476+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:23.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:23.433+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:23.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:23.433+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:24.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:24.447+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:24.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:24.447+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:25.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:25.452+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:25.455 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:25.452+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:26.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:26.477+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:26.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:26.477+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:27.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:27.459+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:27.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:27.459+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:28.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:28.473+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:28.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:28.473+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:29.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:29.490+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:29.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:29.490+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:30.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:30.461+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:30.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:30.461+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:31.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:31.486+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:31.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:31.486+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:32.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:32.498+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:32.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:32.499+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:33.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:33.455+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:33.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:33.455+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:34.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:34.422+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:34.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:34.422+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:35.444 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:35.442+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:35.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:35.442+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:36.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:36.486+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:36.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:36.486+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:37.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:37.494+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:37.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:37.494+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:38.471 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:38.463+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:38.471 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:38.463+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:39.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:39.431+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:39.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:39.431+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:40.413 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:40.410+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:40.413 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:40.410+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:41.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:41.439+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:41.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:41.439+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:42.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:42.438+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:42.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:42.438+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:43.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:43.450+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:43.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:43.450+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:44.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:44.439+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:44.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:44.439+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:45.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:45.417+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:45.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:45.417+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:46.383 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:46.380+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:46.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:46.380+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:47.409 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:47.406+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:47.410 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:47.406+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:48.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:48.442+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:48.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:48.442+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:49.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:49.475+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:49.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:49.475+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:50.447 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:50.444+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:50.448 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:50.444+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:51.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:51.403+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:51.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:51.403+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:52.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:52.402+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:52.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:52.402+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:53.368 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:53.365+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:53.369 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:53.365+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:54.403 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:54.400+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:54.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:54.400+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:55.432 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:55.428+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:55.432 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:55.429+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:56.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:56.449+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:56.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:56.449+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:57.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:57.401+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:57.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:57.401+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:58.410 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:58.407+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:58.410 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:58.407+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:49:59.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:59.379+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:49:59.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:49:59.379+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:00.337 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:00.334+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:00.338 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:00.334+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:01.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:01.327+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:01.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:01.327+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:02.363 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:02.360+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:02.364 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:02.360+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:03.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:03.383+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:03.387 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:03.383+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:04.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:04.398+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:04.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:04.398+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:05.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:05.416+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:05.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:05.416+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:06.455 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:06.453+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:06.456 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:06.453+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:07.448 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:07.445+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:07.448 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:07.445+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:08.444 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:08.441+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:08.444 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:08.441+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:09.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:09.395+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:09.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:09.395+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:10.383 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:10.379+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:10.383 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:10.379+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:11.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:11.337+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:11.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:11.337+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:12.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:12.378+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:12.381 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:12.378+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:13.360 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:13.357+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:13.361 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:13.357+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:14.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:14.319+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:14.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:14.319+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:15.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:15.307+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:15.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:15.307+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:16.279 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:16.277+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:16.280 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:16.277+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:17.308 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:17.305+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:17.308 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:17.305+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:18.270 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:18.266+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:18.270 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:18.266+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:19.314 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:19.311+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:19.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:19.311+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:20.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:20.312+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:20.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:20.312+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:21.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:21.351+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:21.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:21.351+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:22.369 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:22.366+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:22.369 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:22.366+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:23.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:23.382+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:23.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:23.382+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:24.360 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:24.357+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:24.360 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:24.357+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:25.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:25.391+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:25.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:25.391+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:26.392 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:26.389+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:26.392 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:26.389+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:27.377 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:27.375+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:27.378 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:27.375+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:28.427 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:28.425+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:28.427 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:28.425+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:29.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:29.380+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:29.383 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:29.380+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:30.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:30.353+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:30.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:30.353+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:31.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:31.401+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:31.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:31.401+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:32.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:32.357+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:32.360 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:32.357+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:33.362 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:33.359+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:33.362 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:33.359+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:34.410 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:34.408+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:34.411 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:34.408+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:35.361 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:35.359+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:35.362 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:35.359+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:36.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:36.320+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:36.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:36.320+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:37.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:37.318+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:37.331 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:37.318+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:38.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:38.330+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:38.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:38.330+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:39.355 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:39.352+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:39.355 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:39.352+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:40.395 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:40.393+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:40.395 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:40.393+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:41.374 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:41.372+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:41.375 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:41.372+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:42.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:42.332+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:42.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:42.332+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:43.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:43.342+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:43.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:43.343+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:44.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:44.378+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:44.381 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:44.378+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:45.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:45.362+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:45.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:45.362+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:46.352 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:46.349+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:46.352 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:46.349+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:47.373 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:47.370+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:47.373 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:47.371+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:48.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:48.403+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:48.406 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:48.403+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:49.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:49.364+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:49.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:49.364+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:50.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:50.364+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:50.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:50.364+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:51.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:51.383+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:51.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:51.383+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:52.338 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:52.336+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:52.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:52.336+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:53.353 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:53.351+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:53.353 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:53.351+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:54.396 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:54.394+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:54.396 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:54.394+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:55.383 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:55.381+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:55.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:55.381+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:56.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:56.397+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:56.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:56.397+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:57.438 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:57.436+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:57.438 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:57.436+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:58.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:58.400+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:58.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:58.400+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:50:59.373 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:59.370+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:50:59.373 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:50:59.370+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:00.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:00.400+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:00.403 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:00.400+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:01.451 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:01.449+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:01.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:01.449+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:02.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:02.459+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:02.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:02.459+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:03.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:03.433+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:03.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:03.433+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:04.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:04.395+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:04.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:04.395+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:05.414 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:05.411+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:05.414 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:05.411+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:06.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:06.433+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:06.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:06.433+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:07.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:07.465+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:07.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:07.465+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:08.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:08.449+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:08.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:08.449+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:09.465 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:09.462+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:09.465 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:09.462+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:10.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:10.430+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:10.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:10.430+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:11.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:11.460+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:11.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:11.460+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:12.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:12.490+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:12.494 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:12.490+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:13.486 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:13.482+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:13.486 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:13.482+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:14.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:14.493+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:14.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:14.493+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:15.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:15.476+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:15.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:15.476+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:16.483 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:16.480+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:16.483 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:16.480+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:17.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:17.513+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:17.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:17.513+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:18.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:18.477+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:18.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:18.477+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:19.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:19.455+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:19.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:19.455+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:20.512 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:20.505+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:20.515 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:20.505+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:21.483 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:21.480+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:21.483 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:21.480+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:22.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:22.529+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:22.533 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:22.529+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:23.512 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:23.509+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:23.512 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:23.509+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:24.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:24.460+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:24.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:24.460+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:25.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:25.462+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:25.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:25.462+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:26.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:26.465+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:26.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:26.465+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:27.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:27.416+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:27.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:27.416+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:28.444 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:28.441+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:28.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:28.441+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:29.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:29.436+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:29.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:29.436+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:30.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:30.476+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:30.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:30.476+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:31.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:31.442+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:31.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:31.442+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:32.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:32.394+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:32.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:32.394+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:33.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:33.353+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:33.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:33.353+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:34.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:34.307+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:34.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:34.307+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:35.329 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:35.326+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:35.329 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:35.326+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:36.304 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:36.301+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:36.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:36.301+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:37.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:37.262+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:37.266 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:37.262+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:38.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:38.307+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:38.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:38.307+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:39.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:39.340+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:39.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:39.340+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:40.324 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:40.320+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:40.324 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:40.320+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:41.276 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:41.274+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:41.277 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:41.274+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:42.257 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:42.253+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:42.257 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:42.253+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:43.242 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:43.239+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:43.242 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:43.239+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:44.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:44.201+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:44.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:44.201+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:45.180 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:45.178+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:45.181 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:45.178+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:46.177 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:46.175+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:46.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:46.175+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:47.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:47.201+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:47.205 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:47.201+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:48.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:48.224+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:48.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:48.224+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:49.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:49.192+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:49.195 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:49.192+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:50.174 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:50.172+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:50.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:50.172+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:51.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:51.191+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:51.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:51.191+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:52.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:52.193+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:52.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:52.193+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:53.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:53.224+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:53.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:53.224+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:54.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:54.247+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:54.251 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:54.247+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:55.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:55.240+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:55.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:55.240+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:56.299 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:56.288+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:56.299 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:56.289+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:57.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:57.300+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:57.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:57.300+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:58.255 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:58.252+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:58.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:58.252+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:51:59.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:59.255+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:51:59.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:51:59.255+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:00.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:00.231+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:00.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:00.231+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:01.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:01.278+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:01.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:01.278+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:02.257 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:02.253+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:02.257 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:02.253+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:03.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:03.215+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:03.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:03.215+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:04.187 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:04.183+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:04.187 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:04.183+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:05.161 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:05.159+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:05.162 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:05.159+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:06.183 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:06.180+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:06.183 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:06.180+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:07.158 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:07.156+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:07.159 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:07.156+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:08.159 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:08.157+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:08.160 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:08.157+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:09.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:09.148+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:09.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:09.149+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:10.182 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:10.175+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:10.182 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:10.175+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:11.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:11.211+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:11.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:11.211+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:12.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:12.210+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:12.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:12.210+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:13.167 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:13.165+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:13.168 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:13.165+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:14.216 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:14.213+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:14.216 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:14.213+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:15.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:15.231+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:15.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:15.231+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:16.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:16.202+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:16.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:16.202+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:17.191 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:17.189+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:17.191 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:17.189+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:18.197 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:18.195+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:18.198 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:18.195+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:19.176 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:19.174+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:19.177 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:19.174+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:20.226 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:20.224+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:20.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:20.224+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:21.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:21.245+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:21.248 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:21.245+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:22.217 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:22.214+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:22.217 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:22.214+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:23.264 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:23.262+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:23.264 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:23.262+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:24.251 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:24.249+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:24.251 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:24.249+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:25.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:25.223+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:25.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:25.223+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:26.177 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:26.174+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:26.177 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:26.174+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:27.133 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:27.131+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:27.133 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:27.131+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:28.083 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:28.081+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:28.084 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:28.081+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:29.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:29.101+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:29.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:29.101+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:30.148 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:30.146+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:30.148 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:30.146+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:31.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:31.122+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:31.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:31.122+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:32.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:32.085+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:32.088 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:32.085+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:33.056 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:33.053+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:33.057 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:33.053+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:34.032 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:34.029+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:34.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:34.029+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:35.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:35.068+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:35.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:35.068+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:36.095 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:36.092+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:36.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:36.092+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:37.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:37.082+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:37.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:37.082+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:38.083 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:38.079+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:38.083 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:38.079+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:39.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:39.062+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:39.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:39.062+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:40.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:40.083+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:40.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:40.083+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:41.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:41.068+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:41.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:41.068+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:42.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:42.090+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:42.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:42.090+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:43.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:43.057+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:43.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:43.057+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:44.089 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:44.086+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:44.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:44.086+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:45.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:45.104+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:45.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:45.104+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:46.059 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:46.056+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:46.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:46.056+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:47.083 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:47.079+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:47.083 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:47.079+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:48.089 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:48.086+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:48.089 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:48.086+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:49.064 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:49.061+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:49.064 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:49.061+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:50.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:50.075+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:50.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:50.075+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:51.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:51.097+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:51.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:51.097+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:52.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:52.132+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:52.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:52.132+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:53.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:53.132+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:53.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:53.132+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:54.141 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:54.138+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:54.142 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:54.138+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:55.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:55.176+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:55.180 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:55.176+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:56.145 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:56.142+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:56.145 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:56.142+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:57.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:57.093+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:57.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:57.093+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:58.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:58.107+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:58.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:58.107+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:52:59.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:59.121+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:52:59.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:52:59.121+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:00.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:00.135+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:00.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:00.135+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:01.099 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:01.096+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:01.099 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:01.096+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:02.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:02.066+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:02.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:02.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:03.079 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:03.076+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:03.079 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:03.076+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:04.116 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:04.113+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:04.116 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:04.113+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:05.152 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:05.150+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:05.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:05.150+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:06.124 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:06.121+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:06.124 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:06.121+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:07.168 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:07.165+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:07.169 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:07.165+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:08.185 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:08.182+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:08.185 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:08.182+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:09.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:09.175+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:09.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:09.175+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:10.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:10.217+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:10.220 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:10.217+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:11.239 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:11.237+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:11.240 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:11.237+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:12.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:12.232+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:12.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:12.232+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:13.222 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:13.219+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:13.223 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:13.219+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:14.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:14.261+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:14.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:14.262+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:15.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:15.216+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:15.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:15.216+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:16.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:16.201+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:16.205 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:16.201+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:17.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:17.231+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:17.234 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:17.231+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:18.274 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:18.272+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:18.275 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:18.272+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:19.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:19.240+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:19.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:19.240+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:20.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:20.263+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:20.266 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:20.263+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:21.270 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:21.266+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:21.270 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:21.267+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:22.297 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:22.294+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:22.297 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:22.294+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:23.294 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:23.291+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:23.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:23.291+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:24.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:24.313+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:24.316 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:24.313+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:25.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:25.328+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:25.331 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:25.328+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:26.282 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:26.279+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:26.282 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:26.279+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:27.277 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:27.275+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:27.278 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:27.275+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:28.228 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:28.225+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:28.229 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:28.225+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:29.237 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:29.234+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:29.237 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:29.234+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:30.257 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:30.255+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:30.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:30.255+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:31.267 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:31.264+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:31.267 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:31.264+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:32.238 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:32.236+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:32.239 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:32.236+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:33.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:33.213+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:33.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:33.213+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:34.168 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:34.166+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:34.169 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:34.166+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:35.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:35.118+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:35.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:35.118+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:36.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:36.075+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:36.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:36.075+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:37.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:37.088+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:37.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:37.088+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:38.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:38.083+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:38.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:38.083+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:39.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:39.065+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:39.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:39.065+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:40.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:40.026+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:40.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:40.026+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:41.009 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:41.007+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:41.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:41.007+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:41.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:41.980+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:41.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:41.980+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:42.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:42.946+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:42.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:42.946+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:43.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:43.992+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:43.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:43.992+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:44.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:44.948+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:44.952 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:44.948+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:45.945 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:45.942+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:45.945 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:45.942+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:46.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:46.899+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:46.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:46.899+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:47.877 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:47.875+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:47.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:47.875+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:48.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:48.884+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:48.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:48.884+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:49.924 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:49.921+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:49.924 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:49.921+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:50.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:50.944+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:50.947 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:50.944+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:51.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:51.912+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:51.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:51.913+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:52.967 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:52.963+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:52.968 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:52.963+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:53.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:53.983+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:53.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:53.983+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:54.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:54.986+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:54.989 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:54.986+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:56.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:56.002+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:56.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:56.002+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:57.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:57.027+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:57.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:57.027+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:58.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:58.060+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:58.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:58.060+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:53:59.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:59.070+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:53:59.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:53:59.070+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:00.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:00.108+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:00.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:00.108+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:01.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:01.110+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:01.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:01.110+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:02.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:02.093+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:02.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:02.093+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:03.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:03.128+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:03.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:03.128+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:04.145 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:04.142+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:04.146 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:04.142+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:05.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:05.114+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:05.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:05.114+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:06.098 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:06.094+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:06.098 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:06.094+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:07.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:07.131+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:07.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:07.131+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:08.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:08.118+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:08.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:08.118+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:09.099 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:09.096+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:09.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:09.096+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:10.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:10.066+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:10.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:10.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:11.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:11.058+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:11.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:11.058+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:12.050 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:12.047+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:12.050 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:12.047+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:13.001 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:12.998+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:13.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:12.998+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:13.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:13.992+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:13.996 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:13.992+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:14.986 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:14.983+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:14.986 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:14.983+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:15.954 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:15.951+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:15.955 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:15.951+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:16.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:16.939+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:16.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:16.939+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:17.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:17.943+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:17.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:17.943+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:18.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:18.962+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:18.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:18.962+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:19.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:19.928+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:19.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:19.928+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:20.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:20.899+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:20.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:20.899+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:21.887 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:21.884+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:21.887 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:21.884+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:22.883 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:22.880+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:22.884 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:22.880+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:23.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:23.832+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:23.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:23.832+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:24.885 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:24.882+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:24.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:24.882+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:25.924 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:25.907+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:25.925 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:25.907+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:26.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:26.866+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:26.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:26.866+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:27.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:27.841+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:27.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:27.842+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:28.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:28.877+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:28.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:28.877+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:29.906 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:29.904+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:29.918 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:29.904+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:30.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:30.926+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:30.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:30.926+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:31.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:31.932+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:31.936 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:31.932+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:32.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:32.931+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:32.936 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:32.931+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:33.885 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:33.882+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:33.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:33.882+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:34.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:34.846+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:34.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:34.846+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:35.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:35.850+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:35.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:35.850+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:36.872 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:36.869+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:36.873 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:36.869+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:37.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:37.859+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:37.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:37.859+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:38.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:38.837+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:38.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:38.837+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:39.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:39.848+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:39.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:39.848+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:40.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:40.837+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:40.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:40.837+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:41.868 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:41.866+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:41.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:41.866+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:42.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:42.849+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:42.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:42.849+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:43.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:43.809+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:43.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:43.809+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:44.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:44.825+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:44.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:44.825+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:45.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:45.822+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:45.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:45.822+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:46.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:46.820+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:46.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:46.820+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:47.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:47.836+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:47.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:47.836+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:48.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:48.789+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:48.792 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:48.789+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:49.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:49.825+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:49.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:49.825+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:50.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:50.807+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:50.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:50.807+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:51.858 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:51.855+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:51.858 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:51.855+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:52.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:52.889+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:52.892 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:52.889+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:53.934 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:53.931+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:53.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:53.931+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:54.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:54.883+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:54.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:54.883+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:55.910 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:55.908+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:55.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:55.908+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:56.924 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:56.922+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:56.924 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:56.922+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:57.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:57.877+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:57.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:57.877+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:58.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:58.843+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:58.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:58.843+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:54:59.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:59.795+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:54:59.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:54:59.795+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:00.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:00.798+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:00.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:00.798+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:01.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:01.806+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:01.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:01.806+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:02.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:02.826+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:02.829 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:02.826+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:03.803 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:03.800+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:03.803 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:03.801+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:04.776 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:04.774+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:04.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:04.774+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:05.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:05.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:05.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:05.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:06.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:06.718+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:06.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:06.718+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:07.686 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:07.683+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:07.686 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:07.684+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:08.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:08.642+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:08.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:08.642+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:09.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:09.634+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:09.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:09.634+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:10.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:10.668+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:10.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:10.668+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:11.670 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:11.667+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:11.670 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:11.667+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:12.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:12.625+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:12.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:12.625+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:13.672 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:13.670+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:13.672 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:13.670+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:14.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:14.641+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:14.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:14.641+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:15.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:15.664+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:15.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:15.664+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:16.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:16.701+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:16.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:16.701+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:17.654 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:17.652+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:17.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:17.652+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:18.670 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:18.664+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:18.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:18.664+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:19.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:19.706+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:19.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:19.706+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:20.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:20.661+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:20.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:20.661+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:21.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:21.644+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:21.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:21.644+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:22.697 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:22.694+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:22.697 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:22.695+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:23.673 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:23.671+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:23.674 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:23.671+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:24.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:24.664+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:24.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:24.664+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:25.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:25.639+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:25.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:25.639+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:26.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:26.630+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:26.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:26.630+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:27.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:27.631+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:27.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:27.631+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:28.592 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:28.589+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:28.593 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:28.589+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:29.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:29.593+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:29.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:29.593+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:30.558 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:30.555+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:30.559 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:30.555+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:31.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:31.560+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:31.564 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:31.560+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:32.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:32.525+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:32.565 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:32.525+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:33.491 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:33.488+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:33.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:33.488+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:34.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:34.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:34.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:34.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:35.498 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:35.495+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:35.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:35.495+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:36.546 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:36.543+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:36.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:36.543+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:37.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:37.496+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:37.500 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:37.496+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:38.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:38.534+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:38.537 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:38.534+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:39.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:39.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:39.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:39.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:40.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:40.604+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:40.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:40.604+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:41.619 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:41.616+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:41.619 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:41.616+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:42.613 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:42.610+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:42.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:42.610+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:43.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:43.644+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:43.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:43.644+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:44.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:44.604+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:44.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:44.604+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:45.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:45.584+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:45.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:45.584+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:46.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:46.610+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:46.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:46.610+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:47.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:47.649+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:47.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:47.649+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:48.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:48.648+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:48.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:48.648+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:49.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:49.626+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:49.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:49.627+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:50.595 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:50.592+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:50.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:50.592+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:51.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:51.617+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:51.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:51.618+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:52.629 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:52.626+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:52.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:52.626+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:53.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:53.634+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:53.638 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:53.634+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:54.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:54.630+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:54.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:54.630+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:55.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:55.631+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:55.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:55.631+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:56.625 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:56.622+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:56.625 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:56.622+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:57.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:57.661+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:57.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:57.661+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:58.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:58.633+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:58.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:58.633+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:55:59.602 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:59.599+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:55:59.603 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:55:59.599+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:00.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:00.645+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:00.649 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:00.645+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:01.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:01.606+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:01.610 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:01.606+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:02.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:02.651+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:02.654 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:02.651+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:03.629 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:03.626+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:03.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:03.626+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:04.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:04.615+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:04.619 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:04.615+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:05.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:05.642+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:05.646 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:05.642+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:06.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:06.633+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:06.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:06.633+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:07.592 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:07.589+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:07.592 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:07.589+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:08.584 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:08.581+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:08.585 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:08.581+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:09.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:09.605+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:09.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:09.605+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:10.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:10.601+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:10.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:10.601+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:11.585 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:11.582+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:11.585 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:11.582+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:12.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:12.541+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:12.544 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:12.541+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:13.501 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:13.498+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:13.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:13.498+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:14.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:14.506+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:14.509 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:14.506+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:15.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:15.531+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:15.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:15.531+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:16.556 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:16.554+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:16.557 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:16.554+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:17.595 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:17.592+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:17.595 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:17.592+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:18.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:18.627+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:18.631 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:18.627+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:19.658 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:19.655+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:19.658 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:19.655+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:20.613 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:20.610+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:20.613 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:20.610+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:21.601 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:21.598+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:21.601 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:21.598+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:22.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:22.641+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:22.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:22.641+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:23.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:23.601+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:23.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:23.601+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:24.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:24.601+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:24.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:24.601+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:25.575 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:25.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:25.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:25.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:26.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:26.533+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:26.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:26.533+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:27.548 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:27.546+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:27.549 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:27.546+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:28.510 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:28.508+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:28.510 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:28.508+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:29.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:29.530+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:29.533 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:29.530+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:30.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:30.575+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:30.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:30.575+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:31.531 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:31.529+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:31.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:31.529+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:32.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:32.519+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:32.522 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:32.519+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:33.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:33.506+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:33.509 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:33.506+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:34.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:34.511+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:34.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:34.512+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:35.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:35.466+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:35.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:35.466+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:36.472 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:36.469+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:36.472 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:36.469+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:37.474 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:37.472+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:37.474 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:37.472+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:38.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:38.477+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:38.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:38.477+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:39.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:39.452+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:39.455 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:39.452+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:40.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:40.423+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:40.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:40.423+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:41.438 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:41.436+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:41.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:41.436+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:42.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:42.387+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:42.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:42.388+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:43.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:43.396+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:43.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:43.396+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:44.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:44.427+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:44.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:44.427+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:45.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:45.450+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:45.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:45.450+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:46.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:46.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:46.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:46.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:47.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:47.487+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:47.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:47.487+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:48.525 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:48.523+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:48.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:48.523+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:49.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:49.486+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:49.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:49.486+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:50.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:50.458+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:50.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:50.458+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:51.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:51.463+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:51.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:51.463+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:52.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:52.496+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:52.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:52.496+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:53.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:53.481+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:53.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:53.481+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:54.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:54.512+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:54.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:54.512+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:55.497 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:55.493+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:55.497 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:55.493+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:56.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:56.522+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:56.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:56.522+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:57.552 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:57.548+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:57.552 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:57.548+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:58.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:58.525+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:58.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:58.525+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:56:59.515 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:59.512+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:56:59.515 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:56:59.512+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:00.510 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:00.506+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:00.510 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:00.506+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:01.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:01.471+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:01.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:01.471+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:02.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:02.486+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:02.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:02.486+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:03.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:03.461+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:03.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:03.461+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:04.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:04.487+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:04.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:04.487+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:05.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:05.458+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:05.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:05.458+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:06.433 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:06.430+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:06.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:06.430+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:07.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:07.443+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:07.447 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:07.443+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:08.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:08.426+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:08.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:08.426+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:09.412 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:09.409+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:09.412 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:09.409+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:10.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:10.417+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:10.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:10.417+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:11.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:11.419+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:11.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:11.419+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:12.409 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:12.406+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:12.410 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:12.406+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:13.363 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:13.360+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:13.363 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:13.360+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:14.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:14.338+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:14.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:14.338+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:15.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:15.309+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:15.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:15.309+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:16.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:16.345+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:16.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:16.345+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:17.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:17.319+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:17.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:17.319+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:17.857 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T04:57:17.854+0000 7fbf9651c700 0 -- 172.21.15.17:0/2216422916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3d640410 msgr2=0x559f3d641100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-06-27T04:57:18.353 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:18.350+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:18.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:18.350+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:19.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:19.342+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:19.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:19.342+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:20.393 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:20.390+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:20.393 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:20.390+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:21.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:21.421+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:21.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:21.421+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:22.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:22.405+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:22.409 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:22.405+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:23.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:23.379+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:23.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:23.379+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:24.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:24.339+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:24.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:24.339+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:25.374 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:25.371+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:25.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:25.371+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:26.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:26.416+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:26.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:26.416+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:27.444 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:27.442+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:27.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:27.442+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:28.411 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:28.408+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:28.412 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:28.408+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:29.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:29.418+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:29.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:29.418+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:30.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:30.430+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:30.438 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:30.430+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:31.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:31.447+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:31.450 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:31.447+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:32.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:32.398+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:32.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:32.398+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:33.379 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:33.376+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:33.379 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:33.376+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:34.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:34.346+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:34.350 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:34.346+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:35.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:35.391+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:35.395 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:35.391+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:36.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:36.418+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:36.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:36.418+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:37.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:37.398+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:37.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:37.398+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:38.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:38.444+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:38.447 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:38.444+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:39.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:39.474+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:39.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:39.474+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:40.491 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:40.489+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:40.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:40.489+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:41.520 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:41.518+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:41.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:41.518+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:42.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:42.477+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:47:08.556143+0000 (oldest deadline 2020-06-27T04:47:28.556143+0000) 2020-06-27T04:57:42.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:42.477+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:43.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:43.482+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:44.457 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:44.455+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:45.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:45.438+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:46.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:46.450+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:47.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:47.478+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:48.520 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:48.517+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:49.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:49.564+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:50.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:50.593+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:51.585 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:51.582+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:52.610 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:52.607+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:53.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:53.606+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:54.573 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:54.569+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:55.531 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:55.528+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:56.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:56.526+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:57.501 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:57.497+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:58.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:58.449+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:57:59.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:57:59.491+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:00.472 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:00.470+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:01.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:01.482+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:02.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:02.465+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:03.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:03.475+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:04.525 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:04.523+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:04.525 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:04.523+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:05.559 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:05.557+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:05.559 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:05.557+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:06.537 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:06.535+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:06.538 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:06.535+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:07.552 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:07.549+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:07.552 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:07.549+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:08.593 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:08.590+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:08.594 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:08.590+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:09.571 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:09.569+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:09.571 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:09.569+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:10.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:10.538+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:10.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:10.538+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:11.572 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:11.570+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:11.573 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:11.570+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:12.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:12.587+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:12.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:12.587+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:13.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:13.594+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:13.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:13.594+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:14.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:14.553+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:14.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:14.553+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:15.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:15.541+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:15.544 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:15.541+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:16.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:16.585+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:16.588 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:16.585+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:17.540 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:17.538+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:17.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:17.538+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:18.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:18.588+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:18.591 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:18.588+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:19.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:19.638+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:19.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:19.638+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:20.663 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:20.660+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:20.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:20.660+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:21.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:21.702+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:21.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:21.702+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:22.701 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:22.697+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:22.701 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:22.698+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:23.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:23.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:23.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:23.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:24.786 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:24.783+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:24.786 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:24.783+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:25.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:25.796+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:25.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:25.796+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:26.803 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:26.800+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:26.804 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:26.800+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:27.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:27.824+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:27.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:27.824+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:28.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:28.776+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:28.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:28.776+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:29.803 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:29.800+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:29.804 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:29.800+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:30.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:30.785+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:30.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:30.785+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:31.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:31.768+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:31.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:31.768+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:32.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:32.748+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:32.752 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:32.748+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:33.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:33.703+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:33.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:33.703+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:34.656 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:34.653+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:34.657 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:34.653+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:35.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:35.652+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:35.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:35.652+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:36.663 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:36.660+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:36.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:36.660+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:37.619 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:37.616+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:37.619 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:37.616+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:38.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:38.587+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:38.591 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:38.587+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:39.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:39.564+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:39.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:39.564+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:40.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:40.590+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:40.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:40.590+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:41.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:41.634+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:41.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:41.634+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:42.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:42.652+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:42.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:42.652+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:43.682 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:43.678+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:43.682 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:43.678+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:44.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:44.718+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:44.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:44.718+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:45.673 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:45.669+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:45.673 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:45.669+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:46.660 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:46.657+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:46.660 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:46.657+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:47.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:47.703+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:47.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:47.703+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:48.735 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:48.732+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:48.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:48.732+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:49.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:49.684+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:49.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:49.684+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:50.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:50.725+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:50.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:50.725+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:51.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:51.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:51.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:51.728+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:52.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:52.724+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:52.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:52.724+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:53.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:53.704+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:53.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:53.704+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:54.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:54.737+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:54.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:54.737+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:55.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:55.720+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:55.724 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:55.720+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:56.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:56.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:56.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:56.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:57.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:57.727+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:57.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:57.727+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:58.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:58.724+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:58.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:58.724+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:58:59.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:59.764+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:58:59.768 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:58:59.764+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:00.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:00.717+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:00.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:00.717+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:01.679 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:01.677+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:01.680 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:01.677+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:02.651 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:02.640+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:02.651 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:02.640+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:03.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:03.632+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:03.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:03.632+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:04.602 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:04.599+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:04.602 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:04.599+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:05.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:05.587+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:05.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:05.587+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:06.588 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:06.585+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:06.588 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:06.585+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:07.539 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:07.536+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:07.540 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:07.536+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:08.582 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:08.579+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:08.583 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:08.579+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:09.561 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:09.558+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:09.561 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:09.558+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:10.520 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:10.517+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:10.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:10.517+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:11.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:11.471+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:11.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:11.471+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:12.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:12.458+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:12.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:12.458+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:13.501 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:13.498+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:13.501 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:13.498+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:14.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:14.510+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:14.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:14.510+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:15.557 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:15.554+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:15.557 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:15.554+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:16.562 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:16.555+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:16.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:16.555+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:17.539 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:17.537+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:17.540 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:17.537+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:18.571 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:18.564+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:18.571 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:18.564+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:19.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:19.613+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:19.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:19.613+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:20.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:20.608+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:20.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:20.608+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:21.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:21.611+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:21.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:21.611+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:22.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:22.643+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:22.646 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:22.643+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:23.598 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:23.595+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:23.598 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:23.595+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:24.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:24.587+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:24.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:24.587+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:25.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:25.613+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:25.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:25.613+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:26.588 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:26.585+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:26.588 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:26.586+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:27.572 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:27.570+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:27.573 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:27.570+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:28.579 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:28.577+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:28.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:28.577+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:29.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:29.620+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:29.623 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:29.620+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:30.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:30.577+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:30.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:30.577+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:31.569 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:31.566+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:31.569 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:31.566+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:32.531 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:32.529+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:32.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:32.529+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:33.572 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:33.570+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:33.573 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:33.570+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:34.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:34.607+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:34.610 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:34.607+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:35.571 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:35.569+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:35.572 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:35.569+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:36.556 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:36.554+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:36.557 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:36.554+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:37.528 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:37.526+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:37.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:37.526+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:38.522 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:38.519+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:38.522 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:38.519+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:39.523 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:39.521+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:39.524 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:39.521+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:40.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:40.503+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:40.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:40.503+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:41.531 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:41.529+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:41.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:41.529+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:42.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:42.490+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:42.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:42.490+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:43.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:43.532+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:43.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:43.532+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:44.583 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:44.581+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:44.584 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:44.581+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:45.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:45.551+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:45.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:45.551+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:46.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:46.561+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:46.564 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:46.561+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:47.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:47.513+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:47.517 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:47.513+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:48.498 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:48.495+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:48.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:48.495+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:49.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:49.473+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:49.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:49.473+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:50.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:50.489+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:50.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:50.489+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:51.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:51.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:51.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:51.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:52.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:52.481+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:52.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:52.481+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:53.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:53.458+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:53.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:53.458+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:54.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:54.486+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:54.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:54.486+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:55.503 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:55.499+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:55.503 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:55.499+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:56.537 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:56.534+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:56.538 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:56.534+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:57.552 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:57.548+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:57.552 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:57.548+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:58.525 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:58.522+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:58.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:58.522+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T04:59:59.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:59.474+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T04:59:59.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T04:59:59.474+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:00.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:00.493+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:00.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:00.493+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:01.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:01.456+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:01.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:01.456+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:02.457 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:02.452+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:02.457 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:02.452+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:03.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:03.451+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:03.455 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:03.451+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:04.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:04.414+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:04.418 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:04.414+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:05.450 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:05.447+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:05.451 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:05.447+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:06.491 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:06.488+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:06.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:06.488+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:07.456 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:07.448+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:07.457 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:07.448+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:08.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:08.431+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:08.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:08.431+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:09.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:09.459+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:09.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:09.459+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:10.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:10.466+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:10.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:10.466+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:11.428 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:11.425+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:11.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:11.425+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:12.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:12.399+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:12.403 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:12.399+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:13.353 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:13.350+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:13.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:13.350+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:14.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:14.335+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:14.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:14.335+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:15.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:15.377+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:15.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:15.377+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:16.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:16.353+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:16.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:16.353+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:17.307 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:17.304+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:17.308 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:17.304+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:18.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:18.342+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:18.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:18.342+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:19.395 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:19.393+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:19.396 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:19.393+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:20.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:20.404+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:20.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:20.404+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:21.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:21.363+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:21.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:21.363+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:22.367 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:22.364+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:22.368 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:22.364+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:23.381 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:23.378+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:23.381 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:23.378+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:24.392 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:24.390+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:24.393 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:24.390+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:25.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:25.401+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:25.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:25.401+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:26.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:26.414+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:26.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:26.414+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:27.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:27.419+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:27.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:27.419+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:28.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:28.401+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:28.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:28.401+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:29.426 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:29.423+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:29.427 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:29.423+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:30.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:30.417+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:30.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:30.417+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:31.447 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:31.445+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:31.448 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:31.445+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:32.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:32.398+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:32.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:32.398+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:33.370 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:33.367+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:33.370 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:33.367+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:34.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:34.368+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:34.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:34.368+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:35.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:35.382+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:35.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:35.382+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:36.415 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:36.412+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:36.416 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:36.412+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:37.413 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:37.409+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:37.413 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:37.409+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:38.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:38.382+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:38.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:38.382+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:39.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:39.422+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:39.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:39.422+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:40.471 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:40.468+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:40.472 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:40.468+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:41.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:41.479+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:41.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:41.479+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:42.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:42.508+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:42.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:42.508+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:43.498 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:43.495+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:43.498 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:43.495+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:44.448 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:44.445+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:44.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:44.445+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:45.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:45.464+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:45.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:45.464+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:46.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:46.490+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:46.494 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:46.490+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:47.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:47.493+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:47.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:47.493+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:48.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:48.458+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:48.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:48.458+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:49.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:49.467+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:49.470 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:49.467+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:50.512 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:50.510+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:50.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:50.510+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:51.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:51.551+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:51.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:51.551+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:52.570 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:52.567+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:52.570 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:52.568+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:53.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:53.533+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:53.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:53.534+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:54.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:54.513+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:54.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:54.513+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:55.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:55.474+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:55.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:55.474+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:56.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:56.437+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:56.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:56.438+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:57.392 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:57.389+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:57.392 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:57.389+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:58.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:58.378+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:58.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:58.378+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:00:59.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:59.383+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:00:59.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:00:59.383+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:00.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:00.351+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:00.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:00.351+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:01.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:01.397+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:01.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:01.397+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:02.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:02.418+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:02.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:02.418+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:03.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:03.388+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:03.391 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:03.388+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:04.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:04.396+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:04.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:04.396+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:05.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:05.437+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:05.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:05.437+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:06.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:06.428+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:06.431 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:06.428+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:07.455 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:07.453+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:07.456 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:07.453+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:08.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:08.475+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:08.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:08.475+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:09.523 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:09.521+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:09.524 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:09.521+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:10.545 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:10.543+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:10.546 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:10.543+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:11.565 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:11.563+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:11.565 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:11.563+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:12.550 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:12.548+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:12.551 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:12.548+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:13.530 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:13.527+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:13.530 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:13.527+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:14.556 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:14.552+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:14.556 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:14.552+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:15.601 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:15.598+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:15.601 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:15.598+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:16.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:16.576+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:16.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:16.576+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:17.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:17.539+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:17.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:17.540+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:18.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:18.508+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:18.512 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:18.508+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:19.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:19.551+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:19.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:19.551+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:20.584 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:20.581+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:20.585 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:20.581+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:21.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:21.603+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:21.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:21.603+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:22.582 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:22.579+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:22.582 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:22.579+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:23.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:23.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:23.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:23.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:24.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:24.532+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:24.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:24.532+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:25.512 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:25.509+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:25.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:25.509+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:26.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:26.505+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:26.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:26.505+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:27.473 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:27.470+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:27.473 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:27.470+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:28.474 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:28.471+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:28.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:28.471+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:29.523 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:29.520+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:29.523 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:29.520+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:30.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:30.533+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:30.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:30.533+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:31.544 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:31.541+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:31.544 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:31.541+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:32.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:32.563+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:32.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:32.563+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:33.594 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:33.591+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:33.595 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:33.591+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:34.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:34.623+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:34.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:34.623+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:35.585 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:35.581+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:35.585 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:35.581+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:36.545 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:36.542+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:36.545 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:36.542+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:37.503 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:37.500+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:37.504 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:37.500+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:38.487 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:38.484+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:38.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:38.484+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:39.528 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:39.525+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:39.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:39.525+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:40.509 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:40.506+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:40.509 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:40.506+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:41.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:41.508+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:41.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:41.508+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:42.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:42.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:42.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:42.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:43.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:43.500+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:43.503 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:43.500+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:44.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:44.489+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:44.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:44.489+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:45.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:45.455+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:45.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:45.455+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:46.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:46.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:46.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:46.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:47.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:47.523+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:47.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:47.523+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2020-06-27T05:01:47.892+0000 7fbf9651c700 0 -- 172.21.15.17:0/2216422916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf780346b0 msgr2=0x7fbf78036aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-06-27T05:01:48.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:48.509+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:48.512 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:48.509+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:49.531 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:49.528+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:49.531 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:49.528+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:50.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:50.504+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:50.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:50.504+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:51.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:51.540+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:51.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:51.540+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:52.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:52.499+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:52.503 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:52.499+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:53.498 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:53.494+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:53.498 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:53.494+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:54.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:54.478+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:54.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:54.478+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:55.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:55.466+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:55.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:55.466+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:56.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:56.493+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:56.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:56.493+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:57.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:57.486+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:57.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:57.486+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:58.530 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:58.527+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:58.530 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:58.527+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:01:59.550 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:59.544+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:01:59.550 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:01:59.544+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:00.581 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:00.578+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:00.581 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:00.578+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:01.629 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:01.626+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:01.629 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:01.626+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:02.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:02.611+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:02.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:02.611+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:03.572 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:03.569+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:03.573 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:03.569+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:04.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:04.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:04.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:04.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:05.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:05.574+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:05.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:05.574+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:06.558 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:06.555+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:06.558 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:06.555+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:07.564 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:07.561+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:07.565 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:07.561+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:08.550 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:08.547+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:08.550 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:08.547+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:09.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:09.593+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:09.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:09.593+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:10.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:10.638+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:10.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:10.638+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:11.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:11.603+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:11.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:11.603+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:12.579 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:12.576+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:12.579 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:12.576+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:13.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:13.575+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:13.578 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:13.575+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:14.623 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:14.621+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:14.624 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:14.621+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:15.595 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:15.591+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:15.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:15.591+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:16.583 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:16.581+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:16.584 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:16.581+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:17.552 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:17.550+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:17.552 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:17.550+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:18.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:18.505+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:18.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:18.505+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:19.523 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:19.520+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:19.523 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:19.521+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:20.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:20.481+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:20.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:20.482+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:21.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:21.464+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:21.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:21.464+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:22.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:22.492+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:22.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:22.492+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:23.542 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:23.539+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:23.542 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:23.539+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:24.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:24.538+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:24.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:24.538+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:25.542 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:25.540+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:25.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:25.540+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:26.530 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:26.527+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:26.530 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:26.528+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:27.568 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:27.566+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:27.569 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:27.566+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:28.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:28.545+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:28.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:28.545+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:29.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:29.565+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:29.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:29.565+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:30.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:30.534+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:30.537 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:30.534+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:31.515 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:31.513+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:31.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:31.513+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:32.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:32.464+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:32.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:32.464+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:33.486 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:33.483+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:33.486 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:33.483+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:34.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:34.492+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:34.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:34.492+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:35.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:35.462+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:35.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:35.462+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:36.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:36.477+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:36.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:36.477+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:37.500 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:37.497+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:37.500 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:37.497+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:38.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:38.532+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:38.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:38.532+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:39.575 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:39.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:39.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:39.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:40.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:40.551+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:40.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:40.551+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:41.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:41.503+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:41.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:41.503+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:42.509 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:42.505+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:42.509 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:42.505+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:43.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:43.460+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:43.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:43.460+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:44.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:44.422+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:44.426 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:44.422+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:45.431 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:45.428+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:45.432 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:45.428+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:46.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:46.473+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:46.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:46.473+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:47.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:47.426+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:47.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:47.426+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:48.455 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:48.451+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:48.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:48.451+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:49.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:49.472+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:49.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:49.472+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:50.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:50.465+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:50.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:50.465+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:51.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:51.478+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:51.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:51.478+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:52.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:52.457+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:52.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:52.457+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:53.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:53.422+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:53.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:53.422+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:54.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:54.432+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:54.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:54.432+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:55.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:55.395+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:55.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:55.395+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:56.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:56.346+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:56.350 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:56.346+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:57.309 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:57.306+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:57.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:57.306+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:58.290 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:58.287+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:58.290 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:58.287+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:02:59.261 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:59.257+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:02:59.261 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:02:59.257+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:00.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:00.230+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:00.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:00.230+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:01.240 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:01.237+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:01.240 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:01.237+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:02.223 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:02.220+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:02.223 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:02.220+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:03.197 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:03.193+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:03.197 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:03.193+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:04.169 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:04.165+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:04.169 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:04.165+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:05.124 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:05.121+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:05.124 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:05.121+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:06.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:06.145+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:06.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:06.145+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:07.181 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:07.178+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:07.182 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:07.178+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:08.206 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:08.203+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:08.206 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:08.203+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:09.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:09.232+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:09.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:09.232+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:10.239 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:10.236+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:10.240 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:10.236+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:11.224 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:11.221+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:11.224 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:11.221+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:12.266 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:12.263+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:12.266 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:12.263+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:13.314 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:13.311+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:13.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:13.311+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:14.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:14.317+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:14.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:14.317+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:15.284 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:15.281+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:15.285 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:15.281+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:16.239 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:16.236+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:16.239 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:16.236+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:17.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:17.254+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:17.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:17.254+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:18.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:18.300+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:18.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:18.301+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:19.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:19.262+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:19.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:19.262+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:20.242 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:20.239+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:20.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:20.239+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:21.237 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:21.234+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:21.238 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:21.234+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:22.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:22.232+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:22.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:22.232+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:23.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:23.201+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:23.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:23.201+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:24.208 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:24.205+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:24.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:24.205+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:25.174 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:25.171+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:25.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:25.171+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:26.159 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:26.156+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:26.159 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:26.156+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:27.169 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:27.167+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:27.170 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:27.167+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:28.164 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:28.161+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:28.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:28.161+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:29.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:29.200+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:29.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:29.200+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:30.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:30.211+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:30.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:30.211+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:31.199 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:31.196+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:31.200 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:31.196+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:32.249 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:32.246+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:32.249 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:32.246+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:33.199 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:33.197+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:33.200 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:33.197+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:34.158 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:34.155+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:34.158 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:34.155+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:35.137 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:35.135+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:35.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:35.135+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:36.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:36.118+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:36.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:36.118+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:37.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:37.129+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:37.133 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:37.129+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:38.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:38.111+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:38.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:38.111+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:39.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:39.122+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:39.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:39.122+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:40.160 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:40.158+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:40.161 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:40.158+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:41.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:41.117+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:41.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:41.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:42.109 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:42.107+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:42.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:42.107+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:43.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:43.110+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:43.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:43.110+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:44.082 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:44.079+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:44.082 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:44.079+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:45.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:45.035+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:45.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:45.035+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:46.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:46.049+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:46.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:46.049+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:47.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:47.019+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:47.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:47.019+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:48.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:48.041+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:48.045 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:48.041+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:49.016 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:49.013+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:49.016 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:49.013+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:50.001 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:49.998+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:50.001 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:49.998+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:50.996 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:50.993+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:50.997 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:50.993+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:52.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:52.003+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:52.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:52.004+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:52.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:52.971+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:52.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:52.971+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:54.008 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:54.005+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:54.008 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:54.006+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:55.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:55.044+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:55.047 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:55.044+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:56.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:56.018+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:56.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:56.018+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:56.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:56.972+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:56.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:56.972+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:57.937 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:57.935+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:57.938 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:57.935+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:58.979 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:58.977+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:58.980 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:58.977+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:03:59.959 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:59.957+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:03:59.959 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:03:59.957+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:00.953 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:00.951+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:00.954 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:00.951+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:01.990 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:01.988+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:01.991 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:01.988+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:03.008 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:03.006+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:03.008 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:03.006+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:03.992 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:03.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:03.992 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:03.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:04.972 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:04.970+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:04.973 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:04.970+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:05.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:05.925+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:05.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:05.925+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:06.906 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:06.902+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:06.906 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:06.902+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:07.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:07.927+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:07.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:07.927+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:08.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:08.883+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:08.887 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:08.883+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:09.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:09.908+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:09.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:09.908+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:10.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:10.860+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:10.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:10.860+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:11.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:11.816+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:11.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:11.816+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:12.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:12.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:12.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:12.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:13.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:13.824+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:13.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:13.824+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:14.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:14.778+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:14.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:14.778+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:15.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:15.751+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:15.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:15.751+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:16.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:16.790+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:16.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:16.790+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:17.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:17.751+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:17.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:17.751+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:18.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:18.745+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:18.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:18.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:19.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:19.750+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:19.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:19.750+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:20.806 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:20.796+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:20.806 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:20.796+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:21.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:21.782+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:21.786 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:21.782+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:22.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:22.805+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:22.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:22.805+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:23.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:23.822+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:23.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:23.822+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:24.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:24.841+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:24.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:24.841+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:25.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:25.829+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:25.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:25.829+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:26.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:26.821+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:26.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:26.821+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:27.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:27.851+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:27.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:27.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:28.868 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:28.865+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:28.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:28.865+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:29.822 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:29.819+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:29.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:29.819+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:30.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:30.851+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:30.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:30.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:31.818 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:31.815+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:31.818 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:31.815+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:32.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:32.820+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:32.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:32.820+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:33.783 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:33.774+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:33.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:33.774+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:34.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:34.818+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:34.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:34.818+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:35.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:35.780+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:35.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:35.780+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:36.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:36.780+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:36.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:36.780+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:37.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:37.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:37.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:37.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:38.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:38.821+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:38.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:38.821+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:39.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:39.774+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:39.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:39.774+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:40.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:40.769+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:40.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:40.769+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:41.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:41.781+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:41.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:41.781+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:42.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:42.772+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:42.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:42.772+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:43.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:43.784+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:43.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:43.784+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:44.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:44.794+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:44.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:44.794+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:45.759 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:45.757+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:45.760 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:45.757+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:46.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:46.805+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:46.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:46.805+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:47.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:47.829+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:47.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:47.829+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:48.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:48.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:48.795 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:48.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:49.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:49.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:49.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:49.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:50.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:50.753+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:50.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:50.753+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:51.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:51.763+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:51.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:51.763+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:52.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:52.769+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:52.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:52.769+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:53.786 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:53.783+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:53.786 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:53.783+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:54.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:54.740+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:54.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:54.740+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:55.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:55.775+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:55.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:55.775+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:56.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:56.753+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:56.756 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:56.753+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:57.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:57.775+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:57.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:57.775+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:58.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:58.807+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:58.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:58.807+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:04:59.829 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:59.827+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:04:59.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:04:59.827+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:00.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:00.823+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:00.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:00.823+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:01.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:01.788+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:01.792 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:01.788+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:02.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:02.795+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:02.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:02.795+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:03.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:03.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:03.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:03.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:04.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:04.718+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:04.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:04.718+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:05.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:05.765+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:05.768 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:05.765+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:06.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:06.779+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:06.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:06.779+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:07.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:07.820+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:07.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:07.820+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:08.793 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:08.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:08.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:08.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:09.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:09.751+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:09.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:09.751+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:10.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:10.733+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:10.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:10.734+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:11.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:11.709+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:11.713 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:11.709+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:12.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:12.738+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:12.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:12.738+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:13.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:13.734+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:13.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:13.734+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:14.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:14.742+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:14.745 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:14.742+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:15.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:15.721+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:15.724 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:15.721+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:16.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:16.769+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:16.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:16.769+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:17.804 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:17.802+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:17.804 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:17.802+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:18.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:18.767+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:18.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:18.767+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:19.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:19.788+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:19.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:19.788+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:20.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:20.740+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:20.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:20.740+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:21.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:21.727+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:21.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:21.727+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:22.737 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:22.734+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:22.737 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:22.734+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:23.694 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:23.692+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:23.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:23.692+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:24.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:24.720+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:24.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:24.720+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:25.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:25.739+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:25.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:25.739+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:26.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:26.789+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:26.792 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:26.789+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:27.795 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:27.793+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:27.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:27.793+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:28.776 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:28.774+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:28.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:28.774+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:29.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:29.739+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:29.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:29.739+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:30.719 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:30.717+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:30.719 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:30.717+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:31.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:31.745+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:31.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:31.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:32.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:32.704+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:32.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:32.704+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:33.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:33.672+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:33.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:33.672+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:34.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:34.705+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:34.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:34.705+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:35.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:35.692+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:35.696 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:35.692+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:36.735 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:36.731+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:36.735 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:36.731+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:37.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:37.781+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:37.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:37.781+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:38.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:38.762+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:38.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:38.762+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:39.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:39.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:39.795 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:39.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:40.795 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:40.792+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:40.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:40.792+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:41.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:41.785+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:41.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:41.785+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:42.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:42.793+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:42.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:42.793+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:43.769 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:43.765+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:43.769 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:43.765+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:44.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:44.808+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:44.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:44.808+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:45.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:45.774+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:45.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:45.774+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:46.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:46.775+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:46.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:46.775+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:47.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:47.741+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:47.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:47.741+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:48.715 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:48.712+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:48.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:48.712+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:49.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:49.741+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:49.745 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:49.741+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:50.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:50.745+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:50.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:50.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:51.724 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:51.721+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:51.725 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:51.721+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:52.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:52.702+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:52.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:52.702+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:53.745 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:53.742+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:53.746 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:53.742+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:54.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:54.738+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:54.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:54.738+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:55.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:55.770+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:55.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:55.770+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:56.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:56.741+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:56.745 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:56.741+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:57.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:57.783+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:57.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:57.783+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:58.818 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:58.815+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:58.818 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:58.815+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:05:59.805 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:59.802+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:05:59.805 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:05:59.802+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:00.776 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:00.773+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:00.776 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:00.773+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:01.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:01.727+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:01.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:01.727+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:02.682 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:02.679+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:02.683 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:02.679+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:03.670 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:03.667+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:03.670 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:03.667+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:04.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:04.649+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:04.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:04.649+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:05.682 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:05.679+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:05.683 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:05.679+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:06.674 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:06.671+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:06.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:06.671+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:07.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:07.637+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:07.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:07.637+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:08.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:08.673+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:08.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:08.673+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:09.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:09.668+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:09.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:09.668+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:10.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:10.684+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:10.688 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:10.684+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:11.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:11.665+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:11.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:11.665+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:12.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:12.632+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:12.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:12.632+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:13.658 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:13.655+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:13.658 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:13.655+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:14.663 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:14.660+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:14.663 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:14.660+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:15.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:15.663+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:15.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:15.663+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:16.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:16.617+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:16.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:16.617+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:17.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:17.584+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:17.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:17.584+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:18.573 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:18.570+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:18.574 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:18.570+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:19.579 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:19.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:19.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:19.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:20.556 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:20.553+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:20.557 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:20.553+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:21.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:21.603+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:21.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:21.603+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:22.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:22.577+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:22.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:22.577+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:23.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:23.588+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:23.591 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:23.588+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:24.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:24.624+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:24.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:24.624+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:25.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:25.619+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:25.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:25.619+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:26.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:26.609+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:26.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:26.609+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:27.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:27.623+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:27.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:27.623+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:28.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:28.623+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:28.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:28.623+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:29.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:29.663+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:29.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:29.663+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:30.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:30.699+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:30.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:30.699+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:31.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:31.663+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:31.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:31.663+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:32.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:32.693+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:32.696 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:32.693+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:33.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:33.719+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:33.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:33.719+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:34.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:34.709+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:34.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:34.709+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:35.699 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:35.696+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:35.699 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:35.696+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:36.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:36.691+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:36.694 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:36.691+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:37.686 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:37.684+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:37.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:37.684+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:38.639 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:38.637+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:38.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:38.637+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:39.660 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:39.657+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:39.660 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:39.657+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:40.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:40.690+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:40.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:40.690+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:41.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:41.705+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:41.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:41.705+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:42.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:42.748+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:42.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:42.748+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:43.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:43.774+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:43.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:43.774+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:44.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:44.735+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:44.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:44.735+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:45.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:45.725+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:45.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:45.725+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:46.752 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:46.749+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:46.752 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:46.749+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:47.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:47.720+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:47.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:47.720+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:48.680 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:48.678+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:48.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:48.678+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:49.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:49.645+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:49.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:49.645+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:50.688 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:50.686+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:50.689 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:50.686+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:51.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:51.648+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:51.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:51.648+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:52.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:52.612+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:52.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:52.612+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:53.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:53.652+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:53.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:53.652+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:54.682 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:54.679+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:54.682 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:54.680+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:55.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:55.641+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:55.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:55.641+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:56.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:56.639+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:56.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:56.639+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:57.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:57.630+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:57.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:57.630+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:58.665 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:58.663+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:58.665 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:58.663+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:06:59.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:59.665+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:06:59.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:06:59.665+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:00.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:00.708+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:00.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:00.708+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:01.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:01.689+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:01.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:01.689+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:02.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:02.649+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:02.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:02.649+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:03.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:03.639+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:03.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:03.639+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:04.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:04.614+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:04.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:04.614+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:05.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:05.626+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:05.631 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:05.626+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:06.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:06.644+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:06.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:06.644+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:07.686 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:07.683+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:07.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:07.683+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:08.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:08.718+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:08.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:08.718+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:09.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:09.726+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:09.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:09.726+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:10.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:10.745+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:10.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:10.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:11.724 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:11.721+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:11.725 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:11.721+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:12.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:12.745+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:12.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:12.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:13.734 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:13.730+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:13.734 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:13.730+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:14.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:14.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:14.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:14.777+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:15.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:15.804+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:15.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:15.804+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:16.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:16.840+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:16.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:16.840+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:17.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:17.855+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:17.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:17.855+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:18.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:18.841+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:18.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:18.841+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:19.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:19.873+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:19.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:19.873+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:20.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:20.835+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:20.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:20.835+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:21.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:21.824+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:21.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:21.824+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:22.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:22.795+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:22.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:22.795+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:23.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:23.770+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:23.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:23.770+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:24.760 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:24.757+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:24.760 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:24.757+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:25.718 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:25.715+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:25.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:25.715+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:26.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:26.717+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:26.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:26.717+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:27.769 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:27.766+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:27.769 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:27.766+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:28.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:28.762+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:28.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:28.762+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:29.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:29.718+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:29.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:29.718+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:30.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:30.705+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:30.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:30.705+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:31.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:31.736+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:31.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:31.736+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:32.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:32.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:32.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:32.777+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:33.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:33.805+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:33.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:33.805+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:34.783 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:34.781+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:34.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:34.781+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:35.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:35.740+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:35.745 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:35.740+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:36.697 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:36.694+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:36.698 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:36.694+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:37.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:37.665+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:37.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:37.665+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:38.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:38.703+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:38.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:38.703+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:39.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:39.741+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:39.745 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:39.741+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:40.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:40.752+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:40.756 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:40.752+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:41.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:41.767+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:41.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:41.767+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:42.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:42.776+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:42.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:42.776+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:43.769 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:43.766+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:43.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:43.766+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:44.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:44.799+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:44.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:44.799+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:45.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:45.795+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:45.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:45.795+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:46.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:46.793+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:46.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:46.793+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:47.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:47.746+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:47.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:47.746+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:48.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:48.768+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:48.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:48.768+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:49.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:49.806+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:49.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:49.806+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:50.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:50.844+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:50.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:50.844+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:51.865 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:51.862+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:51.866 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:51.862+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:52.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:52.883+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:52.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:52.883+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:53.884 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:53.881+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:53.884 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:53.881+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:54.877 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:54.874+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:54.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:54.874+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:55.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:55.912+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:55.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:55.912+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:56.871 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:56.868+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:56.871 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:56.868+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:57.844 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:57.839+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:57.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:57.839+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:58.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:58.850+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:58.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:58.850+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:07:59.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:59.817+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:07:59.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:07:59.817+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:00.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:00.819+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:00.822 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:00.819+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:01.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:01.810+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:01.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:01.810+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:02.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:02.767+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:02.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:02.767+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:03.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:03.805+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:03.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:03.805+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:04.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:04.821+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:04.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:04.821+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:05.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:05.851+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:05.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:05.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:06.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:06.808+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:06.811 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:06.808+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:07.858 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:07.855+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:07.858 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:07.855+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:08.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:08.830+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:08.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:08.830+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:09.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:09.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:09.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:09.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:10.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:10.796+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:10.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:10.796+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:11.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:11.825+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:11.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:11.825+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:12.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:12.818+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:12.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:12.818+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:13.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:13.828+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:13.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:13.828+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:14.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:14.862+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:14.865 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:14.862+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:15.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:15.900+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:15.903 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:15.900+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:16.917 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:16.914+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T04:57:43.915728+0000 (oldest deadline 2020-06-27T04:58:03.915728+0000) 2020-06-27T05:08:16.917 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:16.914+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:17.967 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:17.964+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:18.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:18.973+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:19.962 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:19.959+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:20.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:20.944+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:21.903 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:21.900+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:22.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:22.899+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:23.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:23.883+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:24.866 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:24.863+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:25.877 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:25.875+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:26.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:26.841+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:27.874 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:27.871+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:28.883 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:28.880+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:29.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:29.878+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:30.873 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:30.870+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:31.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:31.838+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:32.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:32.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:33.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:33.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:34.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:34.836+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:35.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:35.805+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:36.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:36.853+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:37.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:37.843+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:38.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:38.827+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:38.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:38.827+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:39.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:39.824+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:39.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:39.824+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:40.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:40.845+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:40.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:40.845+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:41.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:41.878+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:41.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:41.878+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:42.927 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:42.922+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:42.927 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:42.922+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:43.969 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:43.966+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:43.970 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:43.966+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:44.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:44.970+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:44.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:44.971+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:46.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:46.011+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:46.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:46.011+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:47.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:47.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:47.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:47.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:48.084 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:48.081+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:48.084 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:48.081+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:49.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:49.039+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:49.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:49.039+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:50.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:50.002+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:50.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:50.002+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:50.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:50.984+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:50.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:50.984+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:52.035 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:52.031+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:52.035 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:52.031+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:53.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:53.050+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:53.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:53.050+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:54.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:54.090+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:54.094 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:54.090+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:55.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:55.101+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:55.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:55.101+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:56.126 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:56.123+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:56.127 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:56.123+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:57.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:57.131+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:57.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:57.131+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:58.094 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:58.090+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:58.094 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:58.090+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:08:59.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:59.098+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:08:59.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:08:59.098+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:00.148 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:00.145+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:00.149 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:00.145+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:01.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:01.097+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:01.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:01.097+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:02.139 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:02.136+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:02.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:02.136+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:03.124 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:03.121+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:03.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:03.121+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:04.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:04.097+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:04.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:04.097+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:05.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:05.120+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:05.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:05.120+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:06.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:06.073+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:06.077 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:06.073+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:07.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:07.111+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:07.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:07.111+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:08.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:08.082+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:08.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:08.082+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:09.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:09.045+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:09.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:09.045+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:10.057 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:10.054+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:10.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:10.054+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:11.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:11.035+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:11.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:11.035+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:12.080 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:12.077+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:12.081 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:12.077+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:13.057 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:13.053+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:13.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:13.053+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:14.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:14.042+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:14.045 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:14.042+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:15.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:15.084+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:15.088 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:15.084+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:16.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:16.090+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:16.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:16.090+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:17.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:17.130+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:17.133 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:17.130+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:18.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:18.093+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:18.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:18.093+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:19.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:19.113+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:19.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:19.113+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:20.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:20.129+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:20.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:20.129+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:21.174 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:21.171+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:21.174 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:21.171+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:22.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:22.209+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:22.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:22.209+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:23.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:23.175+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:23.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:23.175+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:24.128 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:24.126+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:24.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:24.126+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:25.094 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:25.089+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:25.095 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:25.089+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:26.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:26.065+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:26.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:26.065+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:27.088 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:27.085+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:27.089 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:27.085+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:28.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:28.093+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:28.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:28.093+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:29.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:29.058+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:29.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:29.058+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:30.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:30.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:30.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:30.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:30.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:30.984+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:30.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:30.984+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:31.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:31.964+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:31.967 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:31.964+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:32.922 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:32.919+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:32.923 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:32.920+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:33.952 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:33.949+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:33.952 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:33.949+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:34.945 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:34.943+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:34.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:34.943+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:35.949 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:35.946+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:35.949 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:35.947+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:36.927 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:36.924+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:36.927 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:36.924+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:37.913 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:37.910+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:37.913 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:37.910+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:38.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:38.909+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:38.912 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:38.909+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:39.912 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:39.910+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:39.913 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:39.910+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:40.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:40.926+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:40.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:40.927+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:41.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:41.973+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:41.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:41.973+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:43.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:42.999+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:43.003 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:42.999+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:44.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:44.028+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:44.031 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:44.028+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:45.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:45.036+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:45.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:45.036+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:46.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:46.083+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:46.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:46.083+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:47.077 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:47.075+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:47.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:47.075+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:48.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:48.044+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:48.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:48.044+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:49.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:49.016+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:49.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:49.016+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:50.049 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:50.047+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:50.050 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:50.047+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:51.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:51.033+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:51.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:51.033+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:52.077 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:52.075+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:52.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:52.075+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:53.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:53.050+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:53.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:53.050+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:54.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:54.025+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:54.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:54.025+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:55.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:55.018+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:55.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:55.018+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:56.051 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:56.046+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:56.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:56.046+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:57.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:57.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:57.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:57.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:58.040 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:58.037+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:58.041 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:58.037+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:59.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:59.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:59.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:59.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:09:59.968 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:59.965+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:09:59.969 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:09:59.965+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:00.957 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:00.953+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:00.957 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:00.954+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:01.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:01.991+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:01.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:01.991+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:02.958 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:02.955+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:02.959 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:02.955+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:03.968 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:03.964+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:03.968 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:03.964+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:04.981 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:04.978+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:04.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:04.978+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:05.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:05.983+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:05.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:05.983+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:07.018 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:07.015+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:07.018 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:07.015+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:07.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:07.980+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:07.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:07.980+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:09.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:09.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:09.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:09.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:10.057 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:10.053+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:10.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:10.053+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:11.050 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:11.047+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:11.051 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:11.047+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:12.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:12.064+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:12.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:12.064+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:13.051 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:13.048+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:13.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:13.048+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:14.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:14.002+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:14.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:14.002+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:14.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:14.973+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:14.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:14.974+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:16.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:16.007+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:16.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:16.007+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:16.962 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:16.959+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:16.963 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:16.959+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:17.950 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:17.946+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:17.950 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:17.946+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:18.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:18.958+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:18.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:18.958+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:20.001 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:19.998+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:20.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:19.998+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:20.972 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:20.969+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:20.973 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:20.969+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:22.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:22.012+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:22.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:22.012+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:23.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:23.048+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:23.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:23.048+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:24.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:24.062+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:24.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:24.062+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:25.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:25.099+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:25.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:25.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:26.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:26.112+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:26.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:26.112+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:27.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:27.111+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:27.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:27.111+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:28.122 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:28.119+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:28.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:28.119+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:29.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:29.105+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:29.109 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:29.105+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:30.144 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:30.141+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:30.145 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:30.141+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:31.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:31.105+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:31.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:31.105+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:32.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:32.093+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:32.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:32.093+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:33.141 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:33.138+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:33.142 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:33.138+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:34.182 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:34.179+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:34.183 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:34.179+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:35.176 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:35.173+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:35.177 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:35.173+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:36.167 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:36.164+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:36.168 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:36.164+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:37.137 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:37.135+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:37.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:37.135+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:38.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:38.132+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:38.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:38.132+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:39.173 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:39.170+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:39.173 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:39.170+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:40.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:40.209+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:40.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:40.209+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:41.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:41.191+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:41.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:41.191+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:42.217 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:42.214+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:42.217 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:42.214+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:43.192 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:43.189+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:43.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:43.189+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:44.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:44.175+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:44.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:44.175+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:45.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:45.210+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:45.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:45.210+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:46.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:46.211+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:46.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:46.211+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:47.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:47.243+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:47.246 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:47.243+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:48.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:48.244+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:48.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:48.244+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:49.242 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:49.240+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:49.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:49.240+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:50.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:50.191+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:50.195 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:50.191+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:51.174 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:51.170+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:51.174 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:51.170+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:52.152 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:52.149+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:52.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:52.149+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:53.139 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:53.136+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:53.139 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:53.136+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:54.092 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:54.089+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:54.092 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:54.089+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:55.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:55.073+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:55.077 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:55.073+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:56.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:56.119+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:56.122 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:56.119+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:57.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:57.150+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:57.154 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:57.151+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:58.147 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:58.143+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:58.147 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:58.143+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:10:59.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:59.111+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:10:59.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:10:59.111+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:00.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:00.131+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:00.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:00.131+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:01.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:01.149+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:01.152 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:01.149+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:02.106 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:02.103+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:02.106 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:02.103+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:03.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:03.063+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:03.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:03.064+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:04.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:04.058+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:04.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:04.058+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:05.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:05.106+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:05.109 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:05.106+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:06.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:06.112+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:06.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:06.112+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:07.154 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:07.151+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:07.154 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:07.151+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:08.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:08.133+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:08.136 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:08.133+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:09.164 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:09.162+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:09.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:09.162+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:10.177 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:10.175+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:10.177 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:10.175+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:11.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:11.190+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:11.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:11.190+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:12.157 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:12.149+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:12.157 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:12.149+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:13.160 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:13.156+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:13.161 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:13.156+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:14.188 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:14.186+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:14.189 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:14.186+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:15.159 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:15.157+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:15.160 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:15.157+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:16.188 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:16.185+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:16.188 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:16.185+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:17.166 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:17.164+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:17.167 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:17.164+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:18.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:18.201+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:18.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:18.201+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:19.158 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:19.156+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:19.159 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:19.156+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:20.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:20.148+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:20.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:20.148+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:21.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:21.189+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:21.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:21.189+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:22.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:22.233+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:22.237 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:22.233+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:23.284 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:23.279+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:23.285 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:23.279+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:24.311 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:24.307+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:24.311 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:24.307+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:25.262 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:25.259+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:25.262 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:25.259+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:26.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:26.299+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:26.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:26.299+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:27.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:27.331+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:27.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:27.331+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:28.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:28.309+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:28.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:28.309+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:29.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:29.341+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:29.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:29.341+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:30.393 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:30.390+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:30.393 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:30.390+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:31.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:31.420+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:31.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:31.420+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:32.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:32.460+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:32.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:32.460+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:33.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:33.435+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:33.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:33.435+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:34.451 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:34.448+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:34.451 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:34.448+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:35.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:35.455+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:35.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:35.455+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:36.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:36.481+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:36.486 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:36.481+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:37.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:37.466+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:37.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:37.466+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:38.518 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:38.515+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:38.518 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:38.515+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:39.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:39.533+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:39.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:39.533+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:40.546 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:40.542+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:40.546 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:40.542+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:41.545 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:41.541+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:41.545 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:41.541+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:42.588 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:42.585+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:42.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:42.585+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:43.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:43.577+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:43.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:43.577+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:44.586 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:44.583+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:44.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:44.583+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:45.624 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:45.621+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:45.625 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:45.621+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:46.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:46.649+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:46.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:46.649+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:47.639 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:47.636+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:47.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:47.636+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:48.631 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:48.628+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:48.631 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:48.628+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:49.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:49.605+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:49.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:49.605+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:50.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:50.631+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:50.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:50.631+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:51.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:51.640+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:51.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:51.640+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:52.599 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:52.596+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:52.600 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:52.596+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:53.571 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:53.568+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:53.572 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:53.568+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:54.581 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:54.578+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:54.581 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:54.578+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:55.600 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:55.597+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:55.601 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:55.597+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:56.560 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:56.557+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:56.561 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:56.557+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:57.574 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:57.570+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:57.575 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:57.571+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:58.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:58.605+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:58.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:58.605+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:11:59.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:59.649+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:11:59.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:11:59.649+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:00.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:00.678+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:00.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:00.678+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:01.672 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:01.668+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:01.673 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:01.669+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:02.684 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:02.680+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:02.684 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:02.680+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:03.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:03.668+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:03.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:03.668+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:04.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:04.704+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:04.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:04.704+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:05.699 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:05.696+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:05.700 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:05.696+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:06.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:06.738+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:06.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:06.738+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:07.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:07.744+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:07.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:07.744+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:08.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:08.704+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:08.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:08.704+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:09.759 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:09.754+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:09.759 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:09.754+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:10.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:10.724+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:10.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:10.724+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:11.688 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:11.679+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:11.689 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:11.679+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:12.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:12.640+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:12.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:12.640+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:13.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:13.634+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:13.638 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:13.634+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:14.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:14.618+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:14.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:14.618+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:15.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:15.663+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:15.666 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:15.663+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:16.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:16.614+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:16.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:16.614+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:17.586 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:17.575+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:17.586 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:17.575+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:18.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:18.618+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:18.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:18.618+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:19.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:19.584+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:19.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:19.584+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:20.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:20.577+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:20.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:20.577+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:21.592 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:21.589+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:21.592 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:21.589+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:22.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:22.544+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:22.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:22.544+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:23.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:23.518+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:23.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:23.518+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:24.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:24.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:24.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:24.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:25.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:25.493+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:25.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:25.493+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:26.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:26.483+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:26.486 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:26.483+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:27.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:27.455+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:27.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:27.455+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:28.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:28.475+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:28.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:28.475+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:29.503 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:29.500+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:29.503 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:29.500+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:30.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:30.465+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:30.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:30.465+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:31.515 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:31.513+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:31.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:31.513+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:32.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:32.487+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:32.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:32.487+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:33.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:33.480+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:33.483 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:33.480+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:34.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:34.457+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:34.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:34.457+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:35.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:35.481+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:35.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:35.481+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:36.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:36.473+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:36.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:36.473+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:37.456 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:37.454+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:37.456 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:37.454+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:38.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:38.461+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:38.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:38.461+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:39.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:39.446+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:39.450 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:39.446+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:40.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:40.440+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:40.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:40.440+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:41.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:41.403+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:41.406 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:41.403+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:42.388 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:42.385+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:42.388 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:42.385+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:43.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:43.347+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:43.350 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:43.347+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:44.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:44.344+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:44.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:44.344+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:45.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:45.309+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:45.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:45.309+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:46.272 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:46.270+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:46.273 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:46.270+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:47.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:47.254+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:47.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:47.254+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:48.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:48.210+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:48.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:48.210+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:49.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:49.255+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:49.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:49.255+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:50.296 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:50.292+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:50.296 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:50.292+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:51.292 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:51.289+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:51.293 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:51.289+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:52.319 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:52.316+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:52.320 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:52.316+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:53.286 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:53.283+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:53.287 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:53.283+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:54.325 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:54.321+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:54.325 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:54.321+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:55.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:55.340+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:55.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:55.340+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:56.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:56.302+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:56.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:56.302+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:57.324 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:57.320+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:57.324 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:57.320+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:58.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:58.355+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:58.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:58.355+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:12:59.370 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:59.367+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:12:59.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:12:59.367+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:00.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:00.404+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:00.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:00.404+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:01.383 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:01.380+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:01.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:01.380+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:02.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:02.355+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:02.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:02.355+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:03.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:03.307+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:03.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:03.307+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:04.301 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:04.298+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:04.302 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:04.298+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:05.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:05.253+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:05.257 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:05.253+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:06.261 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:06.257+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:06.261 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:06.257+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:07.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:07.242+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:07.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:07.242+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:08.242 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:08.239+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:08.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:08.239+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:09.224 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:09.221+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:09.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:09.221+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:10.272 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:10.268+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:10.272 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:10.268+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:11.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:11.318+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:11.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:11.318+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:12.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:12.363+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:12.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:12.363+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:13.331 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:13.324+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:13.331 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:13.324+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:14.337 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:14.334+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:14.338 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:14.334+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:15.325 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:15.322+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:15.326 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:15.322+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:16.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:16.362+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:16.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:16.362+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:17.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:17.402+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:17.406 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:17.402+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:18.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:18.395+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:18.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:18.395+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:19.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:19.345+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:19.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:19.345+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:20.360 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:20.358+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:20.361 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:20.358+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:21.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:21.397+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:21.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:21.397+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:22.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:22.440+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:22.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:22.440+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:23.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:23.399+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:23.403 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:23.399+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:24.383 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:24.379+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:24.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:24.379+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:25.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:25.412+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:25.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:25.412+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:26.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:26.461+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:26.465 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:26.461+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:27.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:27.502+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:27.506 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:27.502+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:28.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:28.531+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:28.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:28.531+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:29.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:29.488+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:29.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:29.488+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:30.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:30.493+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:30.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:30.493+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:31.522 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:31.516+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:31.522 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:31.516+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:32.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:32.477+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:32.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:32.477+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:33.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:33.486+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:33.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:33.486+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:34.519 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:34.516+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:34.519 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:34.516+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:35.524 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:35.520+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:35.524 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:35.520+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:36.520 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:36.517+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:36.520 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:36.517+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:37.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:37.487+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:37.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:37.487+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:38.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:38.505+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:38.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:38.505+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:39.539 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:39.536+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:39.539 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:39.536+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:40.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:40.502+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:40.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:40.502+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:41.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:41.504+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:41.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:41.504+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:42.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:42.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:42.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:42.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:43.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:43.437+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:43.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:43.437+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:44.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:44.450+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:44.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:44.450+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:45.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:45.490+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:45.494 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:45.490+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:46.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:46.472+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:46.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:46.472+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:47.471 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:47.467+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:47.471 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:47.467+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:48.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:48.504+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:48.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:48.504+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:49.520 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:49.518+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:49.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:49.518+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:50.497 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:50.494+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:50.497 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:50.495+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:51.537 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:51.534+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:51.538 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:51.534+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:52.544 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:52.541+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:52.544 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:52.542+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:53.510 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:53.507+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:53.510 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:53.507+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:54.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:54.505+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:54.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:54.505+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:55.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:55.534+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:55.537 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:55.534+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:56.586 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:56.584+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:56.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:56.584+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:57.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:57.538+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:57.542 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:57.539+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:58.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:58.523+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:58.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:58.523+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:13:59.539 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:59.536+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:13:59.539 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:13:59.536+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:00.506 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:00.504+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:00.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:00.504+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:01.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:01.513+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:01.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:01.513+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:02.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:02.561+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:02.564 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:02.561+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:03.613 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:03.611+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:03.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:03.611+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:04.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:04.564+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:04.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:04.564+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:05.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:05.588+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:05.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:05.588+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:06.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:06.594+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:06.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:06.594+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:07.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:07.606+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:07.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:07.606+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:08.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:08.606+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:08.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:08.606+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:09.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:09.611+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:09.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:09.611+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:10.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:10.624+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:10.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:10.624+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:11.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:11.633+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:11.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:11.633+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:12.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:12.634+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:12.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:12.634+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:13.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:13.605+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:13.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:13.605+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:14.591 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:14.588+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:14.592 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:14.588+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:15.561 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:15.558+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:15.562 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:15.558+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:16.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:16.602+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:16.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:16.602+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:17.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:17.593+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:17.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:17.593+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:18.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:18.614+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:18.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:18.614+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:19.650 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:19.647+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:19.651 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:19.647+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:20.678 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:20.674+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:20.678 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:20.674+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:21.683 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:21.679+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:21.683 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:21.679+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:22.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:22.642+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:22.646 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:22.642+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:23.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:23.692+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:23.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:23.692+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:24.690 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:24.686+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:24.691 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:24.686+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:25.718 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:25.714+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:25.718 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:25.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:26.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:26.745+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:26.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:26.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:27.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:27.754+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:27.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:27.755+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:28.793 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:28.789+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:28.793 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:28.789+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:29.837 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:29.833+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:29.837 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:29.833+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:30.805 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:30.801+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:30.805 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:30.801+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:31.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:31.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:31.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:31.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:32.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:32.796+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:32.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:32.796+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:33.756 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:33.752+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:33.756 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:33.752+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:34.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:34.750+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:34.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:34.750+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:35.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:35.748+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:35.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:35.748+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:36.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:36.750+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:36.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:36.750+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:37.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:37.798+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:37.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:37.798+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:38.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:38.769+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:38.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:38.769+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:39.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:39.729+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:39.733 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:39.729+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:40.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:40.726+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:40.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:40.726+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:41.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:41.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:41.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:41.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:42.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:42.809+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:42.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:42.809+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:43.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:43.853+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:43.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:43.853+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:44.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:44.809+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:44.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:44.809+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:45.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:45.813+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:45.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:45.813+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:46.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:46.856+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:46.860 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:46.856+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:47.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:47.820+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:47.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:47.820+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:48.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:48.794+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:48.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:48.794+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:49.792 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:49.789+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:49.793 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:49.789+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:50.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:50.774+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:50.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:50.774+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:51.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:51.799+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:51.803 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:51.799+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:52.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:52.754+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:52.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:52.754+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:53.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:53.799+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:53.803 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:53.799+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:54.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:54.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:54.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:54.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:55.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:55.764+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:55.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:55.764+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:56.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:56.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:56.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:56.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:57.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:57.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:57.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:57.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:58.805 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:58.801+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:58.805 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:58.801+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:14:59.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:59.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:14:59.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:14:59.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:00.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:00.835+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:00.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:00.835+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:01.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:01.835+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:01.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:01.835+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:02.858 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:02.855+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:02.858 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:02.855+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:03.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:03.849+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:03.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:03.849+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:04.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:04.804+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:04.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:04.804+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:05.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:05.839+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:05.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:05.839+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:06.888 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:06.885+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:06.889 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:06.885+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:07.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:07.928+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:07.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:07.928+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:08.971 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:08.968+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:08.971 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:08.968+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:09.928 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:09.925+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:09.928 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:09.925+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:10.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:10.974+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:10.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:10.974+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:11.959 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:11.956+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:11.959 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:11.956+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:12.949 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:12.946+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:12.950 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:12.946+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:13.913 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:13.910+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:13.913 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:13.910+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:14.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:14.927+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:14.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:14.927+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:15.945 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:15.942+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:15.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:15.942+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:16.953 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:16.950+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:16.953 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:16.951+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:17.991 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:17.988+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:17.991 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:17.988+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:18.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:18.939+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:18.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:18.939+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:19.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:19.892+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:19.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:19.892+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:20.905 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:20.902+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:20.905 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:20.902+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:21.877 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:21.875+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:21.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:21.875+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:22.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:22.850+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:22.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:22.850+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:23.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:23.838+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:23.841 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:23.838+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:24.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:24.873+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:24.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:24.873+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:25.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:25.909+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:25.912 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:25.909+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:26.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:26.875+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:26.879 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:26.876+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:27.919 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:27.917+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:27.920 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:27.917+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:28.914 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:28.906+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:28.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:28.906+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:29.875 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:29.873+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:29.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:29.873+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:30.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:30.867+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:30.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:30.867+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:31.872 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:31.869+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:31.873 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:31.870+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:32.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:32.836+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:32.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:32.836+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:33.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:33.847+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:33.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:33.847+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:34.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:34.889+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:34.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:34.889+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:35.927 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:35.925+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:35.928 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:35.925+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:36.897 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:36.894+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:36.897 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:36.894+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:37.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:37.844+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:37.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:37.844+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:38.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:38.851+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:38.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:38.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:39.829 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:39.825+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:39.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:39.826+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:40.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:40.823+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:40.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:40.823+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:41.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:41.817+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:41.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:41.817+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:42.865 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:42.862+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:42.866 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:42.862+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:43.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:43.842+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:43.845 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:43.842+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:44.843 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:44.839+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:44.843 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:44.839+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:45.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:45.856+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:45.860 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:45.856+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:46.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:46.895+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:46.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:46.895+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:47.887 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:47.884+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:47.887 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:47.884+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:48.916 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:48.913+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:48.916 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:48.913+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:49.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:49.896+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:49.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:49.896+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:50.938 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:50.932+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:50.939 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:50.932+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:51.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:51.929+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:51.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:51.929+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:52.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:52.957+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:52.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:52.958+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:53.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:53.984+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:53.989 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:53.984+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:55.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:55.018+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:55.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:55.018+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:56.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:56.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:56.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:56.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:57.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:57.018+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:57.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:57.018+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:58.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:58.011+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:58.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:58.011+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:15:59.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:59.057+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:15:59.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:15:59.057+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:00.080 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:00.077+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:00.081 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:00.077+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:01.130 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:01.126+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:01.130 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:01.126+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:02.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:02.129+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:02.133 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:02.129+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:03.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:03.097+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:03.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:03.097+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:04.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:04.105+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:04.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:04.105+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:05.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:05.063+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:05.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:05.063+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:06.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:06.097+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:06.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:06.097+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:07.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:07.074+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:07.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:07.074+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:08.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:08.048+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:08.059 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:08.048+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:09.045 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:09.041+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:09.045 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:09.041+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:10.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:10.039+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:10.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:10.039+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:11.059 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:11.055+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:11.059 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:11.055+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:12.059 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:12.056+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:12.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:12.056+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:13.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:13.068+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:13.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:13.068+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:14.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:14.025+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:14.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:14.025+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:14.986 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:14.983+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:14.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:14.983+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:16.001 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:15.998+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:16.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:15.998+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:16.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:16.970+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:16.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:16.970+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:17.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:17.929+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:17.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:17.929+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:18.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:18.929+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:18.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:18.929+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:19.971 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:19.968+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:19.972 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:19.968+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:20.922 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:20.919+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:20.923 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:20.919+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:21.926 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:21.923+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:21.927 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:21.923+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:22.964 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:22.961+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:22.964 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:22.961+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:23.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:23.991+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:23.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:23.991+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:25.016 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:25.014+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:25.017 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:25.014+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:25.967 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:25.964+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:25.968 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:25.964+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:26.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:26.930+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:26.934 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:26.930+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:27.898 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:27.895+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:27.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:27.895+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:28.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:28.888+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:28.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:28.888+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:29.885 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:29.882+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:29.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:29.882+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:30.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:30.860+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:30.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:30.860+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:31.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:31.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:31.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:31.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:32.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:32.827+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:32.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:32.827+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:33.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:33.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:33.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:33.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:34.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:34.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:34.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:34.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:35.756 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:35.753+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:35.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:35.753+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:36.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:36.769+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:36.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:36.769+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:37.733 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:37.729+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:37.733 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:37.729+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:38.737 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:38.734+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:38.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:38.734+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:39.694 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:39.692+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:39.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:39.692+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:40.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:40.682+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:40.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:40.682+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:41.651 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:41.648+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:41.651 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:41.648+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:42.670 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:42.668+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:42.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:42.668+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:43.701 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:43.699+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:43.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:43.699+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:44.715 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:44.713+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:44.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:44.713+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:45.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:45.718+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:45.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:45.718+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:46.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:46.741+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:46.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:46.741+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:47.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:47.707+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:47.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:47.707+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:48.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:48.752+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:48.756 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:48.753+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:49.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:49.774+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:49.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:49.774+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:50.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:50.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:50.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:50.728+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:51.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:51.750+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:51.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:51.750+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:52.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:52.755+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:52.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:52.755+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:53.806 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:53.804+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:53.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:53.804+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:54.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:54.787+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:54.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:54.787+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:55.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:55.799+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:55.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:55.800+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:56.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:56.765+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:56.768 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:56.765+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:57.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:57.721+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:57.724 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:57.721+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:58.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:58.734+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:58.737 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:58.734+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:16:59.768 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:59.765+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:16:59.768 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:16:59.765+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:00.733 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:00.730+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:00.733 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:00.730+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:01.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:01.709+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:01.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:01.709+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:02.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:02.756+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:02.759 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:02.756+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:03.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:03.745+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:03.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:03.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:04.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:04.742+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:04.745 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:04.742+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:05.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:05.756+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:05.759 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:05.756+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:06.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:06.727+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:06.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:06.727+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:07.700 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:07.697+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:07.701 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:07.697+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:08.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:08.717+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:08.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:08.717+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:09.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:09.743+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:09.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:09.743+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:10.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:10.783+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:10.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:10.783+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:11.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:11.770+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:11.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:11.770+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:12.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:12.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:12.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:12.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:13.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:13.827+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:13.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:13.827+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:14.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:14.838+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:14.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:14.838+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:15.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:15.847+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:15.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:15.847+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:16.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:16.821+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:16.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:16.821+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:17.837 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:17.834+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:17.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:17.834+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:18.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:18.852+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:18.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:18.852+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:19.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:19.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:19.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:19.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:20.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:20.768+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:20.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:20.768+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:21.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:21.805+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:21.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:21.806+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:22.786 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:22.782+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:22.786 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:22.782+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:23.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:23.815+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:23.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:23.815+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:24.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:24.846+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:24.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:24.846+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:25.871 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:25.868+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:25.872 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:25.868+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:26.912 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:26.909+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:26.913 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:26.909+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:27.928 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:27.925+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:27.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:27.925+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:28.927 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:28.924+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:28.928 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:28.924+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:29.920 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:29.917+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:29.920 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:29.917+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:30.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:30.943+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:30.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:30.943+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:31.922 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:31.919+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:31.922 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:31.919+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:32.910 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:32.907+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:32.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:32.907+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:33.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:33.861+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:33.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:33.861+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:34.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:34.846+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:34.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:34.846+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:35.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:35.847+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:35.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:35.847+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:36.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:36.822+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:36.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:36.822+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:37.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:37.787+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:37.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:37.787+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:38.776 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:38.773+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:38.776 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:38.773+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:39.811 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:39.808+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:39.811 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:39.808+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:40.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:40.795+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:40.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:40.795+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:41.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:41.786+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:41.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:41.786+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:42.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:42.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:42.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:42.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:43.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:43.784+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:43.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:43.784+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:44.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:44.743+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:44.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:44.743+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:45.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:45.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:45.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:45.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:46.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:46.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:46.733 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:46.728+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:47.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:47.736+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:47.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:47.736+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:48.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:48.745+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:48.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:48.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:49.734 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:49.731+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:49.734 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:49.731+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:50.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:50.754+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:50.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:50.754+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:51.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:51.767+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:51.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:51.767+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:52.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:52.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:52.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:52.777+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:53.793 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:53.790+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:53.793 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:53.790+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:54.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:54.804+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:54.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:54.804+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:55.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:55.799+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:55.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:55.799+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:56.803 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:56.800+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:56.803 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:56.800+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:57.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:57.818+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:57.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:57.818+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:58.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:58.856+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:58.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:58.856+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:17:59.843 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:59.840+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:17:59.843 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:17:59.840+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:00.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:00.825+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:00.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:00.825+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:01.786 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:01.783+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:01.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:01.783+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:02.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:02.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:02.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:02.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:03.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:03.832+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:03.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:03.832+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:04.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:04.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:04.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:04.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:05.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:05.771+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:05.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:05.771+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:06.783 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:06.781+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:06.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:06.781+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:07.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:07.748+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:07.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:07.748+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:08.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:08.723+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:08.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:08.723+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:09.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:09.769+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:09.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:09.769+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:10.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:10.740+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:10.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:10.740+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:11.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:11.729+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:11.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:11.729+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:12.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:12.691+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:12.694 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:12.691+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:13.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:13.729+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:13.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:13.729+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:14.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:14.763+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:14.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:14.764+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:15.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:15.741+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:15.745 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:15.742+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:16.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:16.779+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:16.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:16.779+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:17.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:17.806+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:17.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:17.806+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:18.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:18.778+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:18.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:18.778+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:19.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:19.738+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:19.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:19.738+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:20.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:20.771+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:20.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:20.771+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:21.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:21.768+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:21.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:21.768+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:22.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:22.753+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:22.756 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:22.753+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:23.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:23.750+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:23.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:23.750+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:24.704 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:24.701+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:24.704 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:24.701+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:25.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:25.737+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:25.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:25.737+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:26.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:26.776+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:26.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:26.776+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:27.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:27.727+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:27.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:27.727+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:28.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:28.692+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:28.696 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:28.692+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:29.684 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:29.682+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:29.685 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:29.682+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:30.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:30.689+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:30.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:30.689+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:31.725 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:31.722+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:31.725 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:31.722+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:32.679 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:32.677+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:32.680 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:32.677+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:33.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:33.665+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:33.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:33.665+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:34.639 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:34.635+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:34.639 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:34.635+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:35.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:35.603+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:35.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:35.603+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:36.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:36.617+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:36.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:36.617+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:37.658 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:37.655+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:37.659 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:37.655+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:38.654 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:38.651+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:38.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:38.651+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:39.697 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:39.693+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:39.697 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:39.693+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:40.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:40.708+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:40.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:40.708+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:41.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:41.750+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:41.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:41.750+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:42.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:42.749+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:42.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:42.749+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:43.768 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:43.765+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:43.768 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:43.765+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:44.803 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:44.799+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:44.803 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:44.799+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:45.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:45.830+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:45.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:45.830+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:46.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:46.858+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:46.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:46.858+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:47.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:47.837+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:47.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:47.837+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:48.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:48.853+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:08:17.871566+0000 (oldest deadline 2020-06-27T05:08:37.871566+0000) 2020-06-27T05:18:48.857 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:48.853+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:49.904 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:49.901+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:50.871 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:50.867+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:51.918 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:51.915+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:52.962 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:52.959+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:54.001 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:53.998+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:55.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:55.016+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:56.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:56.003+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:57.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:57.009+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:58.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:58.031+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:18:59.064 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:18:59.061+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:00.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:00.045+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:01.008 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:01.005+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:01.963 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:01.960+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:02.970 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:02.967+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:03.926 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:03.923+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:04.970 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:04.965+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:05.922 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:05.918+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:06.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:06.963+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:07.967 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:07.964+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:08.943 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:08.940+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:09.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:09.985+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:09.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:09.985+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:11.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:11.007+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:11.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:11.007+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:12.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:12.015+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:12.020 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:12.015+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:12.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:12.985+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:12.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:12.985+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:13.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:13.961+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:13.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:13.961+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:14.963 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:14.960+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:14.964 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:14.960+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:15.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:15.939+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:15.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:15.939+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:16.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:16.971+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:16.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:16.971+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:17.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:17.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:17.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:17.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:19.035 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:19.033+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:19.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:19.033+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:20.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:20.050+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:20.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:20.050+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:21.050 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:21.046+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:21.050 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:21.046+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:22.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:22.023+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:22.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:22.023+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:23.032 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:23.030+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:23.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:23.030+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:24.023 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:24.020+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:24.023 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:24.020+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:25.045 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:25.042+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:25.045 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:25.042+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:26.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:26.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:26.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:26.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:26.990 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:26.987+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:26.991 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:26.987+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:28.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:27.988+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:28.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:27.988+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:28.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:28.944+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:28.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:28.944+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:29.958 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:29.955+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:29.958 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:29.955+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:30.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:30.958+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:30.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:30.958+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:31.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:31.927+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:31.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:31.927+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:32.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:32.878+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:32.882 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:32.878+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:33.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:33.897+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:33.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:33.897+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:34.909 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:34.906+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:34.910 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:34.906+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:35.898 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:35.895+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:35.898 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:35.895+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:36.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:36.888+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:36.892 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:36.889+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:37.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:37.843+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:37.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:37.843+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:38.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:38.888+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:38.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:38.888+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:39.905 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:39.903+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:39.906 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:39.903+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:40.922 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:40.919+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:40.923 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:40.919+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:41.908 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:41.906+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:41.909 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:41.906+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:42.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:42.896+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:42.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:42.896+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:43.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:43.908+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:43.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:43.909+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:44.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:44.927+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:44.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:44.927+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:45.882 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:45.879+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:45.882 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:45.879+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:46.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:46.832+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:46.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:46.832+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:47.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:47.806+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:47.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:47.806+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:48.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:48.838+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:48.841 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:48.838+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:49.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:49.837+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:49.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:49.837+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:50.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:50.861+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:50.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:50.861+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:51.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:51.830+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:51.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:51.830+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:52.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:52.861+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:52.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:52.861+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:53.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:53.835+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:53.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:53.835+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:54.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:54.846+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:54.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:54.846+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:55.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:55.817+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:55.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:55.817+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:56.795 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:56.793+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:56.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:56.793+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:57.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:57.814+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:57.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:57.814+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:58.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:58.783+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:58.786 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:58.783+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:19:59.834 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:59.830+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:19:59.834 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:19:59.830+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:00.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:00.782+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:00.786 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:00.782+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:01.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:01.778+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:01.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:01.778+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:02.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:02.743+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:02.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:02.743+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:03.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:03.771+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:03.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:03.771+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:04.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:04.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:04.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:04.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:05.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:05.713+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:05.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:05.713+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:06.674 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:06.671+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:06.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:06.671+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:07.694 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:07.691+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:07.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:07.691+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:08.699 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:08.696+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:08.700 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:08.696+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:09.672 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:09.669+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:09.673 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:09.669+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:10.670 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:10.666+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:10.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:10.667+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:11.688 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:11.685+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:11.689 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:11.685+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:12.649 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:12.646+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:12.650 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:12.646+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:13.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:13.624+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:13.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:13.624+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:14.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:14.657+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:14.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:14.657+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:15.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:15.612+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:15.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:15.612+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:16.670 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:16.660+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:16.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:16.660+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:17.697 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:17.693+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:17.697 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:17.693+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:18.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:18.649+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:18.653 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:18.649+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:19.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:19.601+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:19.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:19.601+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:20.595 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:20.592+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:20.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:20.592+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:21.560 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:21.557+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:21.561 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:21.557+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:22.559 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:22.556+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:22.559 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:22.556+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:23.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:23.520+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:23.527 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:23.520+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:24.570 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:24.566+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:24.570 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:24.566+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:25.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:25.612+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:25.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:25.612+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:26.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:26.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:26.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:26.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:27.638 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:27.617+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:27.639 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:27.617+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:28.654 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:28.651+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:28.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:28.651+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:29.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:29.641+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:29.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:29.641+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:30.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:30.638+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:30.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:30.638+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:31.659 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:31.656+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:31.660 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:31.656+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:32.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:32.705+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:32.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:32.705+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:33.719 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:33.716+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:33.719 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:33.716+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:34.694 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:34.691+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:34.694 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:34.691+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:35.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:35.720+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:35.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:35.720+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:36.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:36.769+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:36.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:36.769+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:37.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:37.745+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:37.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:37.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:38.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:38.722+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:38.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:38.722+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:39.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:39.740+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:39.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:39.740+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:40.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:40.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:40.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:40.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:41.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:41.739+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:41.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:41.739+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:42.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:42.738+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:42.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:42.738+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:43.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:43.713+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:43.717 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:43.713+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:44.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:44.754+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:44.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:44.754+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:45.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:45.733+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:45.737 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:45.733+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:46.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:46.753+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:46.756 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:46.753+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:47.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:47.785+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:47.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:47.785+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:48.759 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:48.756+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:48.759 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:48.756+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:49.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:49.794+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:49.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:49.794+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:50.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:50.783+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:50.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:50.784+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:51.817 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:51.814+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:51.817 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:51.814+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:52.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:52.771+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:52.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:52.771+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:53.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:53.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:53.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:53.777+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:54.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:54.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:54.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:54.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:55.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:55.785+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:55.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:55.785+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:56.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:56.797+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:56.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:56.797+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:57.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:57.772+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:57.776 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:57.772+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:58.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:58.776+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:58.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:58.776+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:20:59.746 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:59.744+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:20:59.747 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:20:59.744+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:00.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:00.764+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:00.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:00.764+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:01.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:01.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:01.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:01.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:02.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:02.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:02.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:02.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:03.756 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:03.753+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:03.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:03.754+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:04.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:04.752+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:04.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:04.752+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:05.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:05.762+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:05.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:05.762+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:06.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:06.805+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:06.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:06.805+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:07.834 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:07.831+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:07.834 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:07.831+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:08.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:08.845+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:08.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:08.845+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:09.818 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:09.816+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:09.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:09.816+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:10.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:10.781+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:10.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:10.781+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:11.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:11.770+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:11.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:11.770+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:12.734 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:12.732+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:12.735 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:12.732+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:13.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:13.746+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:13.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:13.746+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:14.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:14.775+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:14.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:14.775+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:15.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:15.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:15.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:15.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:16.759 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:16.756+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:16.759 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:16.756+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:17.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:17.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:17.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:17.748+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:18.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:18.729+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:18.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:18.729+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:19.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:19.772+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:19.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:19.772+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:20.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:20.816+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:20.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:20.816+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:21.795 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:21.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:21.795 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:21.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:22.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:22.779+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:22.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:22.779+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:23.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:23.829+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:23.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:23.829+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:24.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:24.806+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:24.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:24.806+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:25.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:25.851+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:25.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:25.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:26.885 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:26.882+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:26.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:26.882+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:27.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:27.851+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:27.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:27.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:28.896 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:28.892+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:28.896 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:28.892+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:29.924 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:29.921+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:29.925 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:29.921+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:30.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:30.930+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:30.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:30.930+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:31.936 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:31.933+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:31.937 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:31.933+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:32.972 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:32.969+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:32.972 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:32.969+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:34.016 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:34.012+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:34.016 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:34.012+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:34.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:34.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:34.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:34.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:36.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:36.028+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:36.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:36.028+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:37.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:37.009+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:37.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:37.009+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:38.008 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:38.005+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:38.008 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:38.005+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:39.000 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:38.997+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:39.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:38.997+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:40.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:40.018+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:40.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:40.018+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:41.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:41.007+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:41.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:41.007+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:42.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:42.036+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:42.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:42.036+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:43.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:43.025+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:43.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:43.025+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:43.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:43.979+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:43.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:43.979+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:44.944 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:44.941+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:44.945 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:44.941+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:45.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:45.908+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:45.912 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:45.908+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:46.905 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:46.901+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:46.906 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:46.901+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:47.907 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:47.904+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:47.908 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:47.904+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:48.923 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:48.916+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:48.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:48.916+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:49.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:49.897+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:49.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:49.897+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:50.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:50.848+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:50.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:50.848+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:51.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:51.859+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:51.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:51.859+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:52.874 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:52.870+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:52.875 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:52.870+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:53.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:53.861+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:53.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:53.861+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:54.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:54.889+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:54.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:54.889+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:55.908 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:55.905+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:55.909 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:55.905+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:56.865 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:56.861+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:56.865 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:56.861+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:57.860 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:57.857+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:57.860 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:57.857+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:58.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:58.846+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:58.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:58.846+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:21:59.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:59.849+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:21:59.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:21:59.849+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:00.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:00.820+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:00.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:00.820+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:01.829 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:01.825+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:01.829 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:01.825+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:02.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:02.787+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:02.791 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:02.787+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:03.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:03.784+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:03.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:03.784+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:04.806 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:04.803+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:04.806 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:04.803+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:05.792 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:05.789+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:05.793 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:05.789+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:06.822 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:06.820+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:06.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:06.820+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:07.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:07.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:07.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:07.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:08.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:08.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:08.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:08.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:09.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:09.851+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:09.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:09.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:10.867 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:10.864+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:10.867 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:10.864+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:11.861 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:11.858+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:11.861 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:11.858+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:12.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:12.827+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:12.830 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:12.827+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:13.879 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:13.876+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:13.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:13.876+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:14.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:14.889+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:14.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:14.890+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:15.852 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:15.849+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:15.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:15.849+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:16.868 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:16.864+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:16.868 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:16.864+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:17.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:17.827+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:17.831 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:17.827+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:18.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:18.867+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:18.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:18.867+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:19.858 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:19.855+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:19.858 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:19.855+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:20.879 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:20.876+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:20.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:20.876+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:21.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:21.874+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:21.877 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:21.874+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:22.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:22.845+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:22.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:22.845+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:23.896 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:23.893+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:23.896 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:23.893+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:24.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:24.850+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:24.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:24.850+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:25.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:25.822+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:25.825 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:25.822+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:26.783 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:26.780+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:26.783 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:26.780+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:27.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:27.808+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:27.811 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:27.808+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:28.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:28.806+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:28.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:28.806+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:29.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:29.836+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:29.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:29.836+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:30.887 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:30.885+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:30.888 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:30.885+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:31.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:31.891+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:31.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:31.891+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:32.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:32.844+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:32.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:32.844+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:33.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:33.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:33.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:33.813+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:34.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:34.861+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:34.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:34.861+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:35.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:35.899+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:35.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:35.899+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:36.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:36.898+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:36.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:36.898+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:37.910 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:37.907+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:37.910 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:37.907+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:38.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:38.926+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:38.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:38.926+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:39.882 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:39.879+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:39.883 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:39.880+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:40.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:40.844+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:40.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:40.844+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:41.837 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:41.835+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:41.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:41.835+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:42.879 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:42.876+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:42.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:42.876+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:43.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:43.856+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:43.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:43.856+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:44.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:44.878+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:44.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:44.878+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:45.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:45.877+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:45.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:45.877+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:46.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:46.847+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:46.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:46.847+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:47.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:47.833+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:47.837 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:47.833+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:48.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:48.851+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:48.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:48.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:49.882 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:49.879+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:49.882 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:49.879+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:50.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:50.867+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:50.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:50.867+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:51.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:51.848+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:51.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:51.848+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:52.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:52.812+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:52.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:52.812+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:53.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:53.798+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:53.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:53.798+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:54.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:54.785+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:54.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:54.785+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:55.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:55.771+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:55.781 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:55.771+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:56.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:56.723+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:56.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:56.723+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:57.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:57.744+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:57.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:57.744+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:58.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:58.760+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:58.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:58.760+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:22:59.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:59.798+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:22:59.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:22:59.798+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:00.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:00.803+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:00.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:00.804+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:01.822 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:01.819+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:01.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:01.819+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:02.802 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:02.799+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:02.803 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:02.799+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:03.834 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:03.831+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:03.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:03.831+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:04.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:04.782+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:04.786 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:04.782+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:05.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:05.737+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:05.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:05.737+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:06.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:06.770+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:06.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:06.770+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:07.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:07.815+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:07.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:07.815+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:08.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:08.778+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:08.782 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:08.778+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:09.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:09.816+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:09.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:09.816+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:10.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:10.794+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:10.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:10.794+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:11.763 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:11.759+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:11.763 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:11.759+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:12.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:12.732+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:12.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:12.732+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:13.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:13.708+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:13.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:13.708+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:14.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:14.729+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:14.733 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:14.729+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:15.746 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:15.743+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:15.746 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:15.743+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:16.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:16.751+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:16.755 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:16.751+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:17.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:17.793+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:17.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:17.793+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:18.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:18.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:18.815 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:18.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:19.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:19.784+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:19.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:19.784+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:20.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:20.795+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:20.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:20.795+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:21.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:21.790+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:21.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:21.790+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:22.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:22.809+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:22.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:22.809+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:23.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:23.784+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:23.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:23.784+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:24.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:24.817+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:24.820 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:24.817+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:25.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:25.824+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:25.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:25.824+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:26.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:26.780+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:26.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:26.780+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:27.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:27.750+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:27.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:27.750+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:28.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:28.725+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:28.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:28.725+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:29.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:29.684+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:29.688 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:29.684+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:30.669 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:30.665+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:30.669 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:30.665+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:31.718 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:31.714+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:31.718 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:31.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:32.719 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:32.714+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:32.719 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:32.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:33.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:33.706+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:33.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:33.706+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:34.719 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:34.715+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:34.719 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:34.715+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:35.690 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:35.687+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:35.691 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:35.687+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:36.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:36.639+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:36.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:36.639+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:37.656 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:37.653+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:37.657 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:37.653+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:38.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:38.629+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:38.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:38.629+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:39.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:39.632+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:39.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:39.632+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:40.602 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:40.599+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:40.602 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:40.599+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:41.638 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:41.635+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:41.639 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:41.635+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:42.594 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:42.591+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:42.594 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:42.591+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:43.611 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:43.608+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:43.611 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:43.608+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:44.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:44.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:44.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:44.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:45.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:45.533+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:45.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:45.533+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:46.546 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:46.543+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:46.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:46.543+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:47.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:47.499+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:47.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:47.499+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:48.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:48.489+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:48.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:48.489+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:49.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:49.459+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:49.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:49.459+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:50.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:50.472+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:50.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:50.472+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:51.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:51.438+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:51.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:51.438+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:52.486 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:52.483+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:52.487 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:52.483+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:53.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:53.477+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:53.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:53.477+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:54.431 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:54.428+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:54.432 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:54.428+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:55.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:55.379+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:55.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:55.379+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:56.413 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:56.410+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:56.413 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:56.410+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:57.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:57.401+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:57.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:57.401+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:58.393 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:58.390+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:58.393 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:58.390+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:23:59.363 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:59.361+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:23:59.364 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:23:59.361+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:00.331 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:00.328+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:00.332 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:00.328+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:01.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:01.355+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:01.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:01.355+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:02.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:02.344+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:02.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:02.344+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:03.396 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:03.393+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:03.396 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:03.393+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:04.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:04.421+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:04.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:04.421+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:05.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:05.379+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:05.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:05.379+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:06.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:06.343+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:06.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:06.343+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:07.388 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:07.385+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:07.388 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:07.385+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:08.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:08.382+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:08.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:08.382+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:09.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:09.362+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:09.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:09.362+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:10.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:10.363+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:10.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:10.363+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:11.367 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:11.364+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:11.368 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:11.364+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:12.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:12.402+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:12.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:12.402+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:13.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:13.443+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:13.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:13.443+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:14.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:14.404+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:14.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:14.404+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:15.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:15.419+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:15.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:15.419+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:16.375 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:16.371+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:16.376 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:16.371+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:17.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:17.331+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:17.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:17.331+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:18.292 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:18.290+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:18.293 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:18.290+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:19.309 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:19.307+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:19.309 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:19.307+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:20.278 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:20.274+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:20.278 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:20.274+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:21.232 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:21.227+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:21.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:21.227+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:22.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:22.232+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:22.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:22.232+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:23.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:23.246+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:23.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:23.246+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:24.277 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:24.274+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:24.277 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:24.274+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:25.249 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:25.245+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:25.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:25.245+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:26.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:26.278+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:26.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:26.278+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:27.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:27.259+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:27.264 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:27.259+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:28.264 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:28.261+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:28.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:28.261+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:29.296 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:29.292+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:29.296 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:29.292+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:30.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:30.332+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:30.336 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:30.332+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:31.308 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:31.304+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:31.308 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:31.304+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:32.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:32.302+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:32.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:32.302+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:33.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:33.309+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:33.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:33.309+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:34.287 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:34.284+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:34.288 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:34.284+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:35.244 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:35.241+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:35.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:35.241+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:36.277 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:36.274+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:36.278 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:36.274+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:37.317 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:37.313+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:37.317 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:37.313+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:38.341 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:38.338+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:38.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:38.338+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:39.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:39.311+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:39.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:39.311+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:40.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:40.331+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:40.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:40.331+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:41.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:41.307+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:41.311 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:41.307+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:42.284 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:42.281+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:42.285 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:42.281+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:43.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:43.244+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:43.248 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:43.244+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:44.237 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:44.234+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:44.238 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:44.234+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:45.248 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:45.244+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:45.248 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:45.244+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:46.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:46.254+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:46.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:46.254+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:47.291 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:47.288+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:47.291 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:47.288+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:48.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:48.337+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:48.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:48.337+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:49.307 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:49.304+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:49.307 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:49.304+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:50.271 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:50.268+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:50.271 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:50.268+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:51.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:51.311+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:51.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:51.311+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:52.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:52.318+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:52.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:52.318+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:53.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:53.299+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:53.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:53.299+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:54.269 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:54.265+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:54.269 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:54.265+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:55.223 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:55.220+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:55.223 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:55.220+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:56.195 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:56.191+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:56.195 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:56.191+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:57.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:57.215+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:57.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:57.215+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:58.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:58.209+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:58.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:58.209+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:24:59.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:59.233+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:24:59.237 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:24:59.233+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:00.285 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:00.281+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:00.286 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:00.281+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:01.244 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:01.241+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:01.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:01.241+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:02.286 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:02.283+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:02.287 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:02.283+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:03.320 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:03.317+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:03.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:03.317+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:04.351 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:04.347+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:04.352 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:04.347+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:05.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:05.352+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:05.355 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:05.352+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:06.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:06.368+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:06.372 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:06.368+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:07.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:07.339+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:07.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:07.339+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:08.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:08.303+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:08.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:08.303+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:09.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:09.310+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:09.314 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:09.310+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:10.353 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:10.350+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:10.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:10.350+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:11.317 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:11.314+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:11.318 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:11.314+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:12.341 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:12.334+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:12.341 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:12.334+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:13.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:13.340+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:13.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:13.340+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:14.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:14.367+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:14.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:14.367+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:15.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:15.379+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:15.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:15.379+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:16.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:16.335+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:16.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:16.335+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:17.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:17.327+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:17.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:17.327+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:18.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:18.328+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:18.331 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:18.328+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:19.341 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:19.338+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:19.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:19.338+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:20.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:20.337+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:20.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:20.337+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:21.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:21.342+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:21.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:21.342+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:22.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:22.339+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:22.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:22.339+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:23.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:23.362+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:23.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:23.362+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:24.327 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:24.324+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:24.327 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:24.324+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:25.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:25.356+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:25.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:25.356+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:26.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:26.345+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:26.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:26.345+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:27.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:27.308+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:27.311 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:27.308+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:28.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:28.320+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:28.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:28.320+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:29.290 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:29.288+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:29.291 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:29.288+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:30.324 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:30.321+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:30.324 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:30.321+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:31.311 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:31.308+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:31.311 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:31.308+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:32.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:32.332+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:32.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:32.332+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:33.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:33.331+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:33.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:33.331+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:34.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:34.331+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:34.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:34.331+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:35.311 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:35.309+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:35.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:35.309+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:36.355 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:36.352+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:36.355 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:36.352+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:37.360 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:37.358+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:37.361 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:37.358+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:38.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:38.309+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:38.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:38.309+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:39.304 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:39.301+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:39.304 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:39.301+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:40.292 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:40.290+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:40.293 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:40.290+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:41.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:41.318+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:41.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:41.318+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:42.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:42.331+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:42.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:42.331+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:43.370 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:43.368+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:43.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:43.368+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:44.368 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:44.365+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:44.368 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:44.365+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:45.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:45.354+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:45.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:45.354+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:46.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:46.363+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:46.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:46.363+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:47.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:47.355+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:47.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:47.355+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:48.364 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:48.360+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:48.364 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:48.360+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:49.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:49.398+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:49.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:49.398+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:50.451 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:50.447+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:50.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:50.448+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:51.427 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:51.424+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:51.427 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:51.424+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:52.473 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:52.469+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:52.473 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:52.469+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:53.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:53.422+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:53.426 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:53.422+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:54.383 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:54.379+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:54.383 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:54.379+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:55.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:55.344+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:55.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:55.344+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:56.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:56.346+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:56.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:56.346+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:57.316 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:57.312+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:57.316 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:57.312+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:58.287 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:58.284+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:58.288 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:58.284+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:25:59.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:59.311+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:25:59.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:25:59.311+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:00.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:00.342+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:00.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:00.342+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:01.352 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:01.349+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:01.353 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:01.349+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:02.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:02.319+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:02.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:02.319+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:03.351 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:03.347+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:03.351 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:03.347+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:04.362 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:04.358+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:04.362 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:04.358+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:05.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:05.345+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:05.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:05.345+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:06.378 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:06.374+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:06.379 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:06.374+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:07.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:07.404+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:07.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:07.404+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:08.375 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:08.371+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:08.375 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:08.371+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:09.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:09.331+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:09.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:09.331+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:10.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:10.302+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:10.311 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:10.302+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:11.282 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:11.279+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:11.283 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:11.279+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:12.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:12.277+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:12.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:12.277+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:13.314 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:13.311+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:13.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:13.311+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:14.291 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:14.287+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:14.292 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:14.288+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:15.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:15.259+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:15.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:15.259+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:16.252 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:16.249+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:16.253 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:16.249+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:17.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:17.206+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:17.210 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:17.206+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:18.220 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:18.217+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:18.221 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:18.217+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:19.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:19.193+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:19.197 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:19.193+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:20.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:20.206+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:20.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:20.206+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:21.211 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:21.208+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:21.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:21.208+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:22.177 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:22.174+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:22.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:22.174+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:23.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:23.209+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:23.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:23.209+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:24.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:24.162+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:24.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:24.162+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:25.183 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:25.180+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:25.184 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:25.180+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:26.188 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:26.185+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:26.189 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:26.185+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:27.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:27.223+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:27.226 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:27.223+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:28.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:28.206+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:28.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:28.206+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:29.211 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:29.208+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:29.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:29.208+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:30.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:30.230+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:30.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:30.230+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:31.231 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:31.226+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:31.231 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:31.226+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:32.252 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:32.249+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:32.252 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:32.249+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:33.280 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:33.277+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:33.280 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:33.277+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:34.299 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:34.296+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:34.300 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:34.296+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:35.253 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:35.250+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:35.254 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:35.250+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:36.252 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:36.250+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:36.253 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:36.250+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:37.268 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:37.265+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:37.269 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:37.265+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:38.248 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:38.245+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:38.249 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:38.245+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:39.276 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:39.273+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:39.276 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:39.273+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:40.319 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:40.315+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:40.319 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:40.315+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:41.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:41.341+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:41.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:41.341+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:42.361 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:42.358+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:42.361 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:42.358+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:43.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:43.397+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:43.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:43.397+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:44.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:44.352+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:44.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:44.352+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:45.406 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:45.403+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:45.406 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:45.403+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:46.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:46.405+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:46.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:46.405+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:47.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:47.383+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:47.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:47.383+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:48.377 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:48.374+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:48.377 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:48.374+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:49.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:49.363+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:49.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:49.363+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:50.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:50.387+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:50.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:50.388+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:51.364 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:51.361+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:51.364 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:51.361+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:52.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:52.341+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:52.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:52.342+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:53.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:53.337+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:53.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:53.337+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:54.301 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:54.298+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:54.301 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:54.298+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:55.336 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:55.333+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:55.336 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:55.334+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:56.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:56.343+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:56.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:56.343+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:57.296 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:57.294+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:57.297 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:57.294+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:58.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:58.339+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:58.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:58.339+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:26:59.367 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:59.364+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:26:59.367 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:26:59.364+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:00.328 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:00.325+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:00.328 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:00.325+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:01.302 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:01.299+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:01.302 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:01.299+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:02.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:02.319+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:02.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:02.319+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:03.286 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:03.283+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:03.286 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:03.283+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:04.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:04.310+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:04.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:04.310+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:05.304 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:05.302+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:05.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:05.302+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:06.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:06.345+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:06.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:06.345+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:07.389 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:07.386+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:07.389 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:07.386+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:08.411 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:08.408+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:08.411 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:08.408+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:09.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:09.446+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:09.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:09.446+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:10.426 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:10.423+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:10.426 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:10.423+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:11.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:11.404+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:11.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:11.405+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:12.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:12.441+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:12.444 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:12.441+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:13.483 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:13.480+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:13.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:13.480+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:14.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:14.461+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:14.465 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:14.461+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:15.432 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:15.428+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:15.432 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:15.428+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:16.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:16.382+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:16.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:16.382+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:17.377 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:17.373+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:17.377 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:17.373+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:18.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:18.390+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:18.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:18.390+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:19.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:19.342+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:19.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:19.342+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:20.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:20.353+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:20.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:20.353+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:21.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:21.344+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:21.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:21.344+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:22.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:22.344+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:22.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:22.344+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:23.373 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:23.370+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:23.373 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:23.370+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:24.374 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:24.371+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:24.375 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:24.371+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:25.351 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:25.348+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:25.351 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:25.348+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:26.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:26.368+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:26.372 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:26.368+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:27.412 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:27.408+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:27.412 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:27.408+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:28.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:28.455+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:28.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:28.455+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:29.433 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:29.429+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:29.433 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:29.429+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:30.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:30.396+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:30.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:30.396+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:31.391 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:31.387+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:31.392 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:31.388+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:32.377 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:32.373+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:32.377 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:32.373+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:33.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:33.343+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:33.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:33.343+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:34.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:34.344+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:34.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:34.344+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:35.364 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:35.360+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:35.364 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:35.360+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:36.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:36.402+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:36.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:36.402+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:37.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:37.438+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:37.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:37.438+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:38.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:38.436+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:38.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:38.436+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:39.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:39.477+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:39.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:39.477+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:40.504 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:40.500+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:40.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:40.500+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:41.531 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:41.525+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:41.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:41.526+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:42.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:42.501+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:42.506 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:42.502+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:43.515 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:43.512+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:43.515 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:43.512+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:44.518 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:44.515+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:44.519 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:44.515+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:45.498 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:45.495+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:45.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:45.495+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:46.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:46.480+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:46.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:46.481+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:47.487 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:47.483+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:47.487 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:47.483+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:48.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:48.522+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:48.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:48.522+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:49.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:49.538+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:49.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:49.538+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:50.578 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:50.575+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:50.579 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:50.575+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:51.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:51.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:51.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:51.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:52.586 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:52.583+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:52.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:52.583+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:53.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:53.584+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:53.588 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:53.584+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:54.553 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:54.550+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:54.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:54.550+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:55.556 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:55.553+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:55.557 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:55.553+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:56.599 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:56.595+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:56.599 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:56.595+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:57.610 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:57.607+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:57.610 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:57.607+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:58.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:58.623+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:58.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:58.623+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:27:59.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:59.600+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:27:59.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:27:59.600+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:00.578 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:00.575+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:00.578 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:00.575+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:01.600 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:01.597+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:01.600 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:01.597+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:02.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:02.638+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:02.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:02.638+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:03.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:03.649+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:03.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:03.649+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:04.663 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:04.641+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:04.663 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:04.641+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:05.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:05.614+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:05.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:05.614+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:06.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:06.638+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:06.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:06.638+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:07.603 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:07.600+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:07.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:07.600+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:08.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:08.604+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:08.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:08.604+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:09.595 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:09.592+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:09.595 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:09.592+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:10.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:10.623+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:10.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:10.623+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:11.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:11.633+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:11.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:11.633+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:12.678 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:12.676+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:12.679 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:12.676+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:13.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:13.724+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:13.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:13.724+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:14.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:14.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:14.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:14.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:15.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:15.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:15.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:15.777+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:16.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:16.746+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:16.749 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:16.746+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:17.735 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:17.733+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:17.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:17.733+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:18.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:18.724+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:18.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:18.724+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:19.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:19.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:19.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:19.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:20.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:20.706+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:20.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:20.706+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:21.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:21.727+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:21.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:21.727+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:22.683 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:22.680+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:22.683 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:22.680+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:23.698 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:23.695+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:23.698 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:23.695+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:24.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:24.739+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:24.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:24.739+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:25.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:25.720+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:25.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:25.720+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:26.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:26.748+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:26.752 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:26.748+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:27.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:27.712+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:27.715 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:27.712+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:28.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:28.665+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:28.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:28.665+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:29.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:29.630+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:29.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:29.630+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:30.612 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:30.609+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:30.612 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:30.609+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:31.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:31.641+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:31.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:31.641+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:32.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:32.603+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:32.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:32.603+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:33.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:33.564+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:33.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:33.564+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:34.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:34.551+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:34.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:34.551+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:35.583 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:35.581+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:35.584 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:35.581+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:36.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:36.625+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:36.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:36.625+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:37.629 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:37.627+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:37.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:37.627+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:38.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:38.602+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:38.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:38.602+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:39.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:39.616+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:39.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:39.616+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:40.603 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:40.599+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:40.603 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:40.599+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:41.611 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:41.607+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:41.613 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:41.607+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:42.596 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:42.593+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:42.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:42.593+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:43.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:43.603+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:43.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:43.603+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:44.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:44.585+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:44.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:44.585+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:45.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:45.600+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:45.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:45.600+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:46.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:46.640+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:46.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:46.640+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:47.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:47.630+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:47.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:47.630+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:48.675 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:48.672+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:48.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:48.672+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:49.665 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:49.661+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:49.665 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:49.661+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:50.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:50.624+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:50.628 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:50.624+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:51.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:51.601+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:51.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:51.601+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:52.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:52.594+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:52.598 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:52.594+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:53.599 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:53.596+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:53.599 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:53.596+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:54.551 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:54.547+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:54.551 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:54.547+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:55.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:55.562+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:55.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:55.562+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:56.540 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:56.537+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:56.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:56.537+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:57.579 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:57.576+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:57.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:57.576+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:58.588 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:58.585+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:58.588 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:58.585+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:28:59.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:59.551+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:28:59.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:28:59.551+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:00.578 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:00.574+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:00.578 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:00.574+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:01.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:01.603+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:01.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:01.603+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:02.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:02.603+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:02.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:02.603+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:03.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:03.564+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:03.568 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:03.564+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:04.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:04.552+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:04.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:04.552+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:05.579 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:05.576+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:05.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:05.576+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:06.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:06.544+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:06.548 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:06.544+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:07.565 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:07.562+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:07.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:07.562+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:08.558 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:08.555+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:08.558 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:08.555+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:09.539 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:09.536+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:09.539 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:09.536+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:10.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:10.563+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:10.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:10.563+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:11.540 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:11.537+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:11.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:11.537+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:12.552 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:12.549+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:12.553 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:12.549+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:13.556 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:13.553+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:13.557 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:13.553+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:14.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:14.584+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:14.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:14.584+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:15.604 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:15.601+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:15.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:15.601+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:16.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:16.602+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:16.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:16.602+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:17.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:17.562+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:17.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:17.562+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:18.612 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:18.609+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:18.612 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:18.609+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:19.565 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:19.561+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:19.565 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:19.561+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:20.560 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:20.557+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:20.560 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:20.557+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:21.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:21.531+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:21.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:21.531+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:22.491 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:22.488+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:22.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:22.488+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:23.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:23.481+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:23.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:23.481+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:24.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:24.439+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:18:49.434792+0000 (oldest deadline 2020-06-27T05:19:09.434792+0000) 2020-06-27T05:29:24.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:24.439+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:25.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:25.487+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:26.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:26.510+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:27.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:27.475+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:28.431 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:28.428+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:29.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:29.388+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:30.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:30.383+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:31.376 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:31.373+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:32.353 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:32.350+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:33.372 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:33.369+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:34.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:34.331+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:35.318 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:35.314+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:36.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:36.301+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:37.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:37.335+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:38.375 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:38.372+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:39.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:39.387+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:40.363 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:40.360+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:41.378 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:41.376+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:42.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:42.419+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:43.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:43.383+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:44.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:44.379+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:45.341 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:45.338+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:46.292 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:46.289+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:46.292 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:46.289+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:47.279 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:47.277+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:47.280 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:47.277+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:48.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:48.278+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:48.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:48.278+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:49.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:49.309+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:49.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:49.309+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:50.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:50.303+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:50.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:50.303+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:51.270 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:51.267+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:51.271 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:51.268+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:52.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:52.304+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:52.307 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:52.304+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:53.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:53.338+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:53.341 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:53.338+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:54.309 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:54.306+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:54.309 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:54.306+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:55.304 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:55.301+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:55.304 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:55.301+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:56.279 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:56.277+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:56.280 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:56.277+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:57.277 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:57.272+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:57.278 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:57.272+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:58.272 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:58.270+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:58.273 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:58.270+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:29:59.276 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:59.274+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:29:59.277 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:29:59.274+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:00.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:00.231+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:00.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:00.231+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:01.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:01.211+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:01.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:01.211+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:02.202 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:02.199+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:02.202 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:02.199+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:03.249 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:03.246+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:03.249 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:03.246+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:04.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:04.293+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:04.296 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:04.293+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:05.278 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:05.275+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:05.278 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:05.275+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:06.318 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:06.315+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:06.319 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:06.315+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:07.338 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:07.334+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:07.338 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:07.334+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:08.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:08.339+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:08.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:08.339+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:09.376 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:09.373+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:09.377 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:09.373+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:10.327 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:10.324+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:10.328 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:10.324+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:11.283 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:11.276+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:11.284 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:11.276+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:12.230 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:12.227+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:12.231 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:12.227+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:13.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:13.191+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:13.195 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:13.191+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:14.192 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:14.188+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:14.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:14.189+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:15.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:15.153+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:15.157 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:15.153+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:16.200 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:16.196+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:16.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:16.197+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:17.234 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:17.230+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:17.234 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:17.230+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:18.231 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:18.228+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:18.232 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:18.228+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:19.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:19.221+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:19.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:19.221+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:20.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:20.199+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:20.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:20.199+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:21.240 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:21.236+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:21.240 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:21.236+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:22.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:22.222+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:22.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:22.222+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:23.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:23.230+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:23.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:23.230+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:24.267 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:24.264+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:24.268 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:24.264+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:25.242 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:25.239+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:25.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:25.239+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:26.221 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:26.218+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:26.221 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:26.218+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:27.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:27.211+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:27.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:27.211+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:28.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:28.230+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:28.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:28.230+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:29.268 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:29.265+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:29.268 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:29.265+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:30.223 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:30.219+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:30.223 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:30.219+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:31.181 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:31.178+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:31.182 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:31.178+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:32.195 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:32.192+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:32.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:32.192+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:33.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:33.232+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:33.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:33.232+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:34.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:34.200+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:34.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:34.200+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:35.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:35.210+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:35.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:35.210+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:36.262 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:36.259+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:36.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:36.259+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:37.297 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:37.291+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:37.298 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:37.291+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:38.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:38.244+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:38.296 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:38.244+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:39.272 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:39.269+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:39.272 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:39.269+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:40.257 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:40.254+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:40.257 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:40.254+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:41.255 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:41.252+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:41.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:41.252+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:42.240 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:42.237+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:42.240 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:42.237+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:43.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:43.210+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:43.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:43.210+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:44.215 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:44.212+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:44.216 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:44.212+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:45.186 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:45.183+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:45.187 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:45.183+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:46.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:46.134+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:46.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:46.134+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:47.171 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:47.168+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:47.171 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:47.168+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:48.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:48.132+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:48.136 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:48.132+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:49.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:49.087+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:49.092 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:49.087+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:50.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:50.039+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:50.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:50.039+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:51.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:51.050+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:51.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:51.050+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:52.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:52.073+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:52.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:52.073+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:53.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:53.057+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:53.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:53.057+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:54.056 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:54.053+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:54.057 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:54.053+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:55.025 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:55.022+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:55.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:55.022+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:56.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:56.048+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:56.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:56.048+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:57.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:57.027+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:57.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:57.027+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:58.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:58.043+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:58.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:58.043+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:30:59.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:59.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:30:59.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:30:59.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:00.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:00.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:00.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:00.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:01.059 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:01.057+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:01.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:01.057+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:02.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:02.059+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:02.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:02.059+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:03.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:03.072+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:03.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:03.072+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:04.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:04.090+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:04.094 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:04.090+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:05.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:05.114+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:05.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:05.114+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:06.163 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:06.160+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:06.163 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:06.160+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:07.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:07.116+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:07.119 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:07.116+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:08.088 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:08.085+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:08.088 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:08.085+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:09.128 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:09.125+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:09.128 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:09.125+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:10.099 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:10.096+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:10.099 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:10.097+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:11.063 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:11.061+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:11.064 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:11.061+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:12.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:12.103+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:12.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:12.103+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:13.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:13.108+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:13.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:13.108+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:14.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:14.108+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:14.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:14.108+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:15.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:15.136+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:15.139 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:15.136+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:16.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:16.093+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:16.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:16.093+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:17.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:17.066+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:17.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:17.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:18.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:18.068+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:18.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:18.068+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:19.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:19.021+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:19.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:19.021+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:20.035 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:20.032+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:20.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:20.032+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:21.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:21.029+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:21.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:21.029+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:22.051 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:22.049+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:22.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:22.049+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:23.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:23.022+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:23.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:23.022+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:24.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:24.068+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:24.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:24.068+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:25.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:25.022+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:25.025 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:25.022+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:25.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:25.980+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:25.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:25.980+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:26.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:26.982+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:26.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:26.982+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:27.990 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:27.987+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:27.990 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:27.987+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:29.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:29.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:29.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:29.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:30.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:30.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:30.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:30.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:31.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:31.002+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:31.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:31.002+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:31.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:31.959+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:31.962 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:31.959+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:32.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:32.934+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:32.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:32.934+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:33.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:33.971+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:33.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:33.971+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:35.017 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:35.012+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:35.017 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:35.012+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:36.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:36.009+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:36.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:36.009+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:37.003 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:36.999+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:37.003 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:36.999+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:37.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:37.991+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:37.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:37.991+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:38.958 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:38.954+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:38.959 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:38.955+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:39.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:39.931+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:39.941 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:39.931+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:40.898 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:40.895+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:40.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:40.895+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:41.917 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:41.914+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:41.917 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:41.914+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:42.962 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:42.958+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:42.963 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:42.958+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:43.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:43.929+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:43.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:43.929+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:44.969 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:44.965+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:44.969 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:44.965+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:46.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:45.999+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:46.003 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:45.999+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:47.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:47.043+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:47.047 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:47.043+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:48.074 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:48.070+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:48.074 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:48.070+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:49.092 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:49.089+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:49.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:49.089+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:50.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:50.057+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:50.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:50.057+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:51.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:51.060+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:51.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:51.061+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:52.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:52.072+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:52.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:52.072+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:53.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:53.097+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:53.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:53.097+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:54.126 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:54.123+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:54.127 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:54.123+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:55.146 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:55.142+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:55.146 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:55.142+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:56.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:56.109+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:56.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:56.109+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:57.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:57.129+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:57.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:57.129+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:58.137 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:58.134+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:58.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:58.134+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:31:59.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:59.172+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:31:59.176 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:31:59.172+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:00.172 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:00.169+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:00.172 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:00.169+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:01.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:01.129+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:01.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:01.129+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:02.167 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:02.164+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:02.167 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:02.164+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:03.199 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:03.195+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:03.199 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:03.195+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:04.189 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:04.186+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:04.190 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:04.186+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:05.180 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:05.176+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:05.180 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:05.176+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:06.162 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:06.155+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:06.162 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:06.155+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:07.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:07.203+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:07.211 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:07.204+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:08.237 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:08.233+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:08.238 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:08.233+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:09.283 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:09.280+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:09.283 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:09.280+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:10.241 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:10.237+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:10.242 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:10.237+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:11.220 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:11.217+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:11.220 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:11.217+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:12.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:12.210+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:12.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:12.210+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:13.228 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:13.225+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:13.228 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:13.225+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:14.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:14.175+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:14.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:14.175+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:15.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:15.209+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:15.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:15.209+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:16.239 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:16.235+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:16.239 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:16.235+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:17.206 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:17.203+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:17.206 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:17.203+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:18.166 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:18.163+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:18.166 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:18.163+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:19.144 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:19.141+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:19.145 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:19.141+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:20.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:20.117+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:20.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:20.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:21.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:21.120+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:21.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:21.120+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:22.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:22.111+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:22.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:22.111+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:23.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:23.117+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:23.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:23.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:24.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:24.105+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:24.109 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:24.105+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:25.148 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:25.142+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:25.148 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:25.142+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:26.136 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:26.132+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:26.136 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:26.132+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:27.124 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:27.121+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:27.124 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:27.121+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:28.154 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:28.152+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:28.155 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:28.152+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:29.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:29.153+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:29.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:29.153+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:30.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:30.150+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:30.154 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:30.150+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:31.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:31.153+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:31.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:31.153+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:32.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:32.106+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:32.109 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:32.106+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:33.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:33.068+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:33.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:33.068+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:34.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:34.094+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:34.098 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:34.094+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:35.144 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:35.142+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:35.145 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:35.142+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:36.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:36.190+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:36.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:36.190+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:37.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:37.191+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:37.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:37.191+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:38.155 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:38.152+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:38.155 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:38.152+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:39.152 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:39.150+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:39.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:39.150+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:40.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:40.136+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:40.139 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:40.136+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:41.119 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:41.117+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:41.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:41.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:42.157 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:42.154+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:42.157 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:42.154+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:43.164 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:43.162+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:43.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:43.162+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:44.205 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:44.202+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:44.205 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:44.202+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:45.229 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:45.227+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:45.230 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:45.227+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:46.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:46.225+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:46.228 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:46.225+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:47.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:47.209+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:47.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:47.210+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:48.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:48.200+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:48.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:48.201+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:49.222 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:49.220+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:49.223 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:49.220+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:50.191 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:50.189+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:50.192 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:50.189+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:51.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:51.211+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:51.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:51.211+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:52.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:52.215+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:52.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:52.215+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:53.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:53.234+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:53.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:53.234+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:54.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:54.202+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:54.205 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:54.202+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:55.189 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:55.186+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:55.190 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:55.187+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:56.170 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:56.167+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:56.170 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:56.167+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:57.130 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:57.128+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:57.131 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:57.128+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:58.167 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:58.165+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:58.168 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:58.165+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:32:59.210 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:59.208+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:32:59.211 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:32:59.208+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:00.246 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:00.242+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:00.246 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:00.242+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:01.282 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:01.276+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:01.282 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:01.276+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:02.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:02.232+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:02.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:02.232+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:03.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:03.214+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:03.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:03.214+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:04.181 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:04.177+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:04.181 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:04.177+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:05.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:05.175+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:05.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:05.175+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:06.195 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:06.191+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:06.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:06.191+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:07.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:07.239+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:07.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:07.239+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:08.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:08.241+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:08.246 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:08.241+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:09.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:09.222+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:09.226 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:09.222+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:10.255 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:10.251+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:10.255 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:10.251+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:11.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:11.243+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:11.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:11.243+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:12.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:12.241+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:12.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:12.241+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:13.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:13.252+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:13.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:13.252+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:14.254 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:14.251+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:14.255 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:14.251+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:15.288 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:15.284+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:15.288 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:15.284+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:16.259 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:16.256+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:16.260 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:16.256+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:17.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:17.243+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:17.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:17.243+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:18.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:18.233+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:18.237 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:18.233+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:19.283 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:19.279+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:19.283 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:19.279+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:20.316 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:20.312+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:20.316 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:20.312+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:21.314 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:21.311+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:21.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:21.311+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:22.309 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:22.306+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:22.309 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:22.306+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:23.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:23.330+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:23.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:23.330+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:24.362 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:24.359+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:24.363 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:24.359+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:25.317 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:25.313+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:25.318 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:25.314+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:26.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:26.292+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:26.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:26.292+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:27.326 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:27.323+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:27.326 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:27.323+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:28.294 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:28.291+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:28.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:28.291+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:29.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:29.292+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:29.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:29.292+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:30.326 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:30.323+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:30.327 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:30.323+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:31.299 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:31.296+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:31.299 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:31.296+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:32.260 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:32.257+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:32.261 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:32.257+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:33.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:33.292+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:33.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:33.292+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:34.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:34.320+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:34.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:34.320+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:35.290 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:35.287+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:35.290 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:35.287+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:36.307 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:36.304+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:36.307 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:36.304+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:37.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:37.292+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:37.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:37.292+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:38.316 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:38.313+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:38.317 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:38.313+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:39.317 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:39.314+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:39.318 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:39.314+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:40.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:40.307+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:40.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:40.307+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:41.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:41.339+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:41.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:41.339+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:42.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:42.381+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:42.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:42.381+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:43.374 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:43.371+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:43.375 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:43.371+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:44.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:44.416+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:44.420 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:44.416+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:45.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:45.399+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:45.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:45.399+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:46.414 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:46.410+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:46.414 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:46.410+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:47.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:47.396+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:47.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:47.396+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:48.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:48.380+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:48.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:48.380+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:49.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:49.351+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:49.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:49.351+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:50.326 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:50.323+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:50.327 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:50.323+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:51.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:51.332+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:51.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:51.332+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:52.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:52.309+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:52.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:52.309+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:53.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:53.344+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:53.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:53.344+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:54.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:54.347+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:54.350 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:54.347+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:55.379 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:55.376+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:55.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:55.376+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:56.381 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:56.378+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:56.381 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:56.378+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:57.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:57.340+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:57.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:57.340+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:58.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:58.327+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:58.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:58.327+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:33:59.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:59.300+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:33:59.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:33:59.300+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:00.279 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:00.277+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:00.280 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:00.277+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:01.286 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:01.283+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:01.286 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:01.283+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:02.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:02.331+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:02.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:02.331+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:03.378 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:03.375+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:03.378 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:03.375+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:04.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:04.382+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:04.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:04.382+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:05.388 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:05.385+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:05.389 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:05.385+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:06.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:06.336+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:06.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:06.336+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:07.314 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:07.311+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:07.314 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:07.311+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:08.326 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:08.324+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:08.327 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:08.324+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:09.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:09.303+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:09.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:09.303+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:10.342 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:10.339+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:10.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:10.339+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:11.392 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:11.389+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:11.392 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:11.389+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:12.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:12.384+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:12.387 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:12.384+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:13.376 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:13.373+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:13.376 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:13.373+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:14.367 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:14.364+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:14.367 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:14.364+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:15.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:15.356+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:15.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:15.356+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:16.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:16.337+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:16.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:16.337+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:17.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:17.332+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:17.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:17.332+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:18.302 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:18.299+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:18.302 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:18.299+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:19.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:19.346+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:19.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:19.346+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:20.317 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:20.314+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:20.317 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:20.314+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:21.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:21.311+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:21.314 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:21.311+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:22.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:22.303+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:22.307 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:22.303+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:23.338 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:23.336+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:23.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:23.336+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:24.308 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:24.305+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:24.308 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:24.305+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:25.279 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:25.276+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:25.280 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:25.276+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:26.319 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:26.314+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:26.319 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:26.314+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:27.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:27.344+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:27.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:27.344+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:28.350 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:28.347+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:28.351 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:28.347+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:29.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:29.329+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:29.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:29.329+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:30.326 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:30.323+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:30.327 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:30.323+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:31.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:31.317+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:31.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:31.317+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:32.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:32.356+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:32.360 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:32.356+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:33.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:33.352+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:33.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:33.352+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:34.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:34.394+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:34.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:34.394+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:35.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:35.361+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:35.367 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:35.361+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:36.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:36.340+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:36.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:36.340+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:37.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:37.335+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:37.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:37.335+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:38.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:38.331+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:38.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:38.331+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:39.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:39.345+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:39.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:39.345+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:40.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:40.320+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:40.324 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:40.320+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:41.317 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:41.313+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:41.317 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:41.313+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:42.317 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:42.313+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:42.317 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:42.313+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:43.291 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:43.288+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:43.291 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:43.288+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:44.244 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:44.241+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:44.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:44.241+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:45.220 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:45.216+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:45.221 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:45.216+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:46.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:46.191+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:46.195 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:46.191+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:47.242 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:47.238+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:47.242 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:47.238+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:48.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:48.214+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:48.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:48.214+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:49.205 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:49.202+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:49.206 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:49.202+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:50.251 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:50.246+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:50.251 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:50.246+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:51.266 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:51.262+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:51.267 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:51.262+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:52.259 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:52.256+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:52.260 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:52.256+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:53.210 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:53.207+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:53.211 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:53.207+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:54.249 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:54.246+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:54.249 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:54.246+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:55.222 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:55.219+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:55.222 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:55.219+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:56.207 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:56.204+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:56.208 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:56.204+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:57.232 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:57.229+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:57.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:57.229+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:58.217 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:58.214+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:58.217 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:58.214+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:34:59.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:59.193+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:34:59.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:34:59.193+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:00.234 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:00.231+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:00.234 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:00.231+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:01.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:01.209+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:01.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:01.209+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:02.251 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:02.247+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:02.252 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:02.248+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:03.286 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:03.276+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:03.287 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:03.276+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:04.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:04.318+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:04.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:04.318+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:05.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:05.301+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:05.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:05.302+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:06.273 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:06.270+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:06.274 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:06.270+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:07.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:07.302+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:07.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:07.302+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:08.352 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:08.349+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:08.352 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:08.349+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:09.327 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:09.324+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:09.328 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:09.324+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:10.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:10.341+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:10.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:10.341+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:11.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:11.351+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:11.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:11.351+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:12.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:12.382+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:12.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:12.382+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:13.361 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:13.358+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:13.362 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:13.358+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:14.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:14.377+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:14.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:14.377+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:15.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:15.416+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:15.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:15.416+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:16.444 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:16.441+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:16.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:16.441+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:17.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:17.402+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:17.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:17.402+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:18.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:18.434+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:18.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:18.434+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:19.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:19.401+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:19.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:19.401+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:20.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:20.440+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:20.444 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:20.440+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:21.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:21.457+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:21.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:21.457+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:22.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:22.478+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:22.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:22.478+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:23.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:23.492+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:23.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:23.492+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:24.450 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:24.447+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:24.450 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:24.447+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:25.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:25.459+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:25.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:25.459+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:26.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:26.428+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:26.431 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:26.428+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:27.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:27.391+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:27.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:27.391+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:28.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:28.419+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:28.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:28.419+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:29.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:29.451+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:29.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:29.451+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:30.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:30.489+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:30.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:30.489+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:31.487 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:31.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:31.487 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:31.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:32.451 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:32.449+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:32.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:32.449+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:33.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:33.465+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:33.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:33.465+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:34.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:34.476+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:34.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:34.476+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:35.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:35.518+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:35.522 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:35.519+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:36.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:36.499+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:36.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:36.499+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:37.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:37.487+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:37.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:37.487+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:38.525 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:38.522+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:38.526 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:38.522+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:39.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:39.481+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:39.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:39.481+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:40.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:40.511+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:40.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:40.511+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:41.538 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:41.536+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:41.539 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:41.536+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:42.585 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:42.583+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:42.586 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:42.583+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:43.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:43.551+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:43.554 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:43.551+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:44.528 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:44.526+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:44.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:44.526+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:45.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:45.487+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:45.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:45.487+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:46.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:46.531+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:46.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:46.531+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:47.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:47.514+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:47.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:47.514+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:48.546 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:48.544+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:48.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:48.544+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:49.509 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:49.507+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:49.510 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:49.507+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:50.504 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:50.501+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:50.504 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:50.501+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:51.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:51.461+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:51.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:51.461+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:52.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:52.450+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:52.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:52.450+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:53.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:53.403+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:53.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:53.403+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:54.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:54.433+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:54.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:54.433+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:55.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:55.420+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:55.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:55.420+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:56.473 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:56.470+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:56.474 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:56.470+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:57.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:57.436+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:57.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:57.436+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:58.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:58.455+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:58.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:58.455+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:35:59.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:59.431+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:35:59.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:35:59.431+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:00.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:00.463+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:00.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:00.463+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:01.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:01.454+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:01.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:01.454+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:02.409 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:02.406+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:02.410 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:02.406+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:03.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:03.395+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:03.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:03.395+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:04.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:04.431+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:04.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:04.431+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:05.418 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:05.414+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:05.419 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:05.414+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:06.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:06.426+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:06.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:06.426+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:07.451 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:07.448+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:07.452 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:07.448+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:08.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:08.437+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:08.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:08.437+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:09.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:09.420+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:09.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:09.420+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:10.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:10.398+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:10.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:10.398+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:11.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:11.440+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:11.444 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:11.440+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:12.406 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:12.403+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:12.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:12.403+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:13.433 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:13.430+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:13.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:13.430+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:14.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:14.404+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:14.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:14.404+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:15.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:15.450+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:15.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:15.450+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:16.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:16.455+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:16.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:16.455+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:17.456 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:17.453+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:17.457 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:17.453+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:18.504 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:18.500+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:18.504 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:18.500+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:19.483 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:19.479+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:19.631 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:19.479+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:20.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:20.502+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:20.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:20.502+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:21.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:21.463+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:21.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:21.463+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:22.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:22.419+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:22.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:22.419+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:23.471 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:23.468+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:23.471 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:23.468+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:24.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:24.466+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:24.470 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:24.466+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:25.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:25.442+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:25.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:25.442+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:26.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:26.476+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:26.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:26.476+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:27.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:27.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:27.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:27.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:28.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:28.532+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:28.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:28.532+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:29.579 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:29.576+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:29.579 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:29.576+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:30.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:30.617+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:30.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:30.617+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:31.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:31.629+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:31.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:31.629+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:32.662 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:32.659+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:32.662 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:32.659+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:33.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:33.658+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:33.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:33.658+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:34.686 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:34.680+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:34.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:34.680+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:35.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:35.658+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:35.662 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:35.658+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:36.623 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:36.620+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:36.623 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:36.620+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:37.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:37.587+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:37.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:37.587+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:38.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:38.584+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:38.588 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:38.584+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:39.611 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:39.608+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:39.611 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:39.608+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:40.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:40.611+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:40.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:40.611+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:41.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:41.617+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:41.621 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:41.617+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:42.600 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:42.597+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:42.600 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:42.597+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:43.619 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:43.615+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:43.619 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:43.615+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:44.570 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:44.567+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:44.570 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:44.567+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:45.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:45.540+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:45.543 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:45.540+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:46.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:46.544+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:46.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:46.544+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:47.559 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:47.556+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:47.560 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:47.556+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:48.562 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:48.559+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:48.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:48.559+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:49.522 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:49.519+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:49.523 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:49.519+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:50.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:50.526+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:50.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:50.526+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:51.517 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:51.515+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:51.518 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:51.515+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:52.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:52.529+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:52.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:52.529+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:53.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:53.552+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:53.555 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:53.552+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:54.571 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:54.568+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:54.571 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:54.568+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:55.568 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:55.565+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:55.568 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:55.565+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:56.524 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:56.521+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:56.524 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:56.521+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:57.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:57.545+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:57.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:57.545+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:58.503 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:58.501+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:58.504 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:58.501+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:36:59.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:59.519+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:36:59.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:36:59.519+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:00.493 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:00.490+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:00.494 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:00.491+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:01.447 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:01.444+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:01.447 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:01.444+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:02.457 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:02.455+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:02.458 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:02.455+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:03.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:03.473+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:03.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:03.473+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:04.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:04.463+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:04.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:04.464+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:05.427 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:05.424+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:05.427 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:05.424+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:06.431 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:06.429+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:06.432 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:06.429+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:07.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:07.440+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:07.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:07.440+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:08.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:08.464+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:08.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:08.464+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:09.498 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:09.495+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:09.498 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:09.496+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:10.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:10.483+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:10.486 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:10.483+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:11.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:11.434+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:11.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:11.434+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:12.434 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:12.431+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:12.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:12.431+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:13.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:13.399+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:13.403 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:13.399+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:14.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:14.442+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:14.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:14.442+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:15.396 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:15.394+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:15.397 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:15.394+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:16.373 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:16.370+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:16.373 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:16.370+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:17.365 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:17.362+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:17.366 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:17.362+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:18.409 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:18.407+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:18.410 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:18.407+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:19.379 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:19.377+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:19.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:19.377+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:20.336 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:20.333+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:20.337 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:20.333+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:21.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:21.301+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:21.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:21.301+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:22.299 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:22.295+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:22.299 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:22.295+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:23.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:23.299+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:23.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:23.299+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:24.327 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:24.323+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:24.327 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:24.323+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:25.321 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:25.318+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:25.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:25.318+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:26.304 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:26.301+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:26.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:26.301+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:27.264 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:27.260+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:27.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:27.260+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:28.282 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:28.279+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:28.283 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:28.279+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:29.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:29.292+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:29.296 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:29.292+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:30.338 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:30.334+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:30.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:30.335+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:31.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:31.311+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:31.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:31.311+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:32.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:32.354+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:32.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:32.354+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:33.369 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:33.366+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:33.369 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:33.366+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:34.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:34.354+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:34.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:34.354+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:35.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:35.398+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:35.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:35.398+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:36.438 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:36.434+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:36.438 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:36.434+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:37.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:37.436+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:37.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:37.436+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:38.406 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:38.402+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:38.406 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:38.402+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:39.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:39.376+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:39.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:39.377+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:40.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:40.414+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:40.418 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:40.414+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:41.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:41.397+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:41.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:41.397+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:42.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:42.405+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:42.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:42.405+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:43.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:43.439+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:43.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:43.439+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:44.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:44.488+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:44.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:44.488+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:45.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:45.486+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:45.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:45.487+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:46.533 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:46.530+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:46.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:46.530+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:47.538 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:47.534+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:47.538 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:47.534+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:48.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:48.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:48.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:48.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:49.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:49.594+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:49.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:49.594+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:50.548 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:50.545+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:50.548 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:50.545+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:51.536 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:51.533+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:51.537 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:51.533+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:52.561 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:52.557+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:52.561 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:52.557+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:53.569 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:53.566+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:53.570 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:53.566+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:54.594 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:54.591+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:54.595 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:54.591+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:55.585 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:55.582+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:55.586 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:55.582+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:56.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:56.604+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:56.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:56.604+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:57.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:57.602+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:57.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:57.602+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:58.612 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:58.608+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:58.612 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:58.608+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:37:59.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:59.572+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:37:59.578 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:37:59.572+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:00.551 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:00.548+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:00.552 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:00.548+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:01.593 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:01.590+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:01.594 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:01.590+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:02.574 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:02.571+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:02.574 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:02.571+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:03.546 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:03.543+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:03.546 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:03.543+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:04.560 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:04.557+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:04.561 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:04.557+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:05.549 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:05.546+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:05.549 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:05.546+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:06.528 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:06.524+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:06.528 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:06.524+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:07.517 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:07.514+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:07.518 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:07.514+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:08.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:08.511+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:08.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:08.511+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:09.474 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:09.471+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:09.475 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:09.471+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:10.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:10.509+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:10.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:10.509+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:11.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:11.492+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:11.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:11.492+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:12.461 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:12.458+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:12.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:12.458+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:13.447 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:13.444+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:13.447 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:13.444+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:14.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:14.459+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:14.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:14.459+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:15.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:15.464+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:15.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:15.464+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:16.455 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:16.453+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:16.456 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:16.453+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:17.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:17.482+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:17.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:17.482+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:18.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:18.504+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:18.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:18.504+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:19.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:19.464+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:19.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:19.464+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:20.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:20.442+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:20.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:20.442+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:21.470 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:21.467+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:21.470 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:21.467+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:22.502 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:22.499+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:22.503 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:22.499+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:23.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:23.496+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:23.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:23.496+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:24.525 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:24.522+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:24.525 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:24.522+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:25.561 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:25.558+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:25.562 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:25.559+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:26.586 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:26.584+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:26.587 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:26.584+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:27.599 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:27.597+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:27.599 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:27.597+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:28.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:28.586+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:28.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:28.586+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:29.599 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:29.596+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:29.599 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:29.596+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:30.560 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:30.558+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:30.561 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:30.558+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:31.571 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:31.569+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:31.572 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:31.569+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:32.575 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:32.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:32.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:32.573+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:33.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:33.545+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:33.547 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:33.545+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:34.519 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:34.517+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:34.520 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:34.517+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:35.517 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:35.514+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:35.517 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:35.514+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:36.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:36.502+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:36.505 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:36.502+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:37.494 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:37.492+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:37.494 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:37.492+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:38.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:38.459+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:38.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:38.459+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:39.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:39.508+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:39.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:39.508+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:40.472 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:40.469+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:40.472 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:40.469+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:41.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:41.428+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:41.431 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:41.428+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:42.410 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:42.407+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:42.411 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:42.407+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:43.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:43.368+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:43.372 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:43.368+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:44.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:44.343+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:44.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:44.343+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:45.297 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:45.294+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:45.297 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:45.294+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:46.297 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:46.294+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:46.297 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:46.294+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:47.290 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:47.284+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:47.291 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:47.284+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:48.262 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:48.258+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:48.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:48.258+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:49.302 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:49.296+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:49.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:49.296+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:50.294 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:50.291+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:50.295 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:50.291+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:51.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:51.309+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:51.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:51.309+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:52.269 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:52.265+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:52.269 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:52.265+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:53.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:53.260+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:53.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:53.260+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:54.257 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:54.253+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:54.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:54.253+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:55.301 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:55.298+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:55.302 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:55.298+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:56.279 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:56.275+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:56.279 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:56.275+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:57.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:57.312+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:57.316 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:57.312+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:58.298 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:58.294+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:58.298 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:58.294+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:38:59.288 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:59.285+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:38:59.288 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:38:59.285+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:00.326 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:00.322+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:00.326 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:00.322+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:01.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:01.356+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:01.360 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:01.356+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:02.374 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:02.371+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:02.375 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:02.371+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:03.337 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:03.334+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:03.338 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:03.334+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:04.348 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:04.345+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:04.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:04.345+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:05.355 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:05.352+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:05.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:05.352+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:06.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:06.401+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:06.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:06.401+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:07.375 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:07.372+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:07.376 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:07.372+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:08.416 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:08.413+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:08.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:08.413+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:09.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:09.418+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:09.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:09.418+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:10.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:10.457+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:10.460 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:10.457+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:11.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:11.451+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:11.459 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:11.451+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:12.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:12.473+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:12.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:12.473+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:13.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:13.465+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:13.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:13.465+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:14.484 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:14.481+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:14.485 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:14.481+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:15.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:15.436+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:15.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:15.436+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:16.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:16.461+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:16.464 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:16.461+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:17.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:17.463+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:17.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:17.463+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:18.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:18.466+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:18.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:18.466+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:19.470 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:19.467+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:19.470 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:19.467+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:20.509 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:20.506+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:20.509 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:20.506+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:21.560 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:21.555+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:21.560 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:21.555+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:22.510 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:22.507+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:22.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:22.507+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:23.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:23.479+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:23.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:23.479+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:24.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:24.463+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:24.467 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:24.463+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:25.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:25.428+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:25.431 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:25.428+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:26.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:26.432+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:26.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:26.432+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:27.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:27.419+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:27.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:27.419+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:28.411 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:28.408+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:28.412 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:28.408+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:29.429 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:29.426+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:29.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:29.426+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:30.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:30.433+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:30.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:30.433+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:31.387 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:31.383+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:31.387 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:31.383+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:32.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:32.336+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:32.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:32.336+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:33.374 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:33.371+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:33.375 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:33.371+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:34.422 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:34.419+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:34.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:34.419+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:35.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:35.432+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:35.435 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:35.432+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:36.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:36.436+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:36.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:36.436+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:37.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:37.463+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:37.466 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:37.463+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:38.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:38.477+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:38.481 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:38.477+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:39.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:39.497+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:39.514 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:39.497+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:40.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:40.471+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:40.478 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:40.471+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:41.512 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:41.509+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:41.512 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:41.509+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:42.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:42.476+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:42.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:42.476+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:43.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:43.443+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:43.446 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:43.443+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:44.418 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:44.415+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:44.418 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:44.415+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:45.432 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:45.429+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:45.433 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:45.429+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:46.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:46.383+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:46.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:46.383+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:47.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:47.383+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:47.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:47.383+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:48.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:48.397+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:48.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:48.397+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:49.364 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:49.362+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:49.364 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:49.362+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:50.332 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:50.330+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:50.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:50.330+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:51.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:51.337+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:51.340 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:51.337+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:52.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:52.310+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:52.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:52.310+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:53.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:53.307+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:53.310 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:53.307+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:54.268 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:54.266+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:54.269 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:54.266+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:55.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:55.217+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:55.220 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:55.217+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:56.215 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:56.213+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:56.216 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:56.213+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:57.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:57.198+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:57.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:57.198+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:58.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:58.172+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:58.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:58.172+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:39:59.183 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:59.181+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:39:59.183 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:39:59.181+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:00.230 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:00.227+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:40:00.230 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:00.227+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:01.254 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:01.252+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:29:26.193391+0000 (oldest deadline 2020-06-27T05:29:46.193391+0000) 2020-06-27T05:40:01.255 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:01.252+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:02.283 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:02.280+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:03.283 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:03.281+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:04.275 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:04.273+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:05.289 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:05.287+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:06.327 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:06.324+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:07.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:07.342+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:08.319 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:08.317+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:09.296 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:09.293+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:10.272 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:10.269+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:11.259 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:11.256+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:12.234 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:12.231+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:13.261 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:13.259+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:14.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:14.273+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:15.272 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:15.268+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:16.254 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:16.250+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:17.269 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:17.266+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:18.230 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:18.227+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:19.208 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:19.205+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:20.184 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:20.181+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:21.184 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:21.178+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:22.173 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:22.170+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:23.202 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:23.199+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:24.187 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:24.183+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:25.185 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:25.181+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:25.185 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:25.181+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:26.163 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:26.159+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:26.163 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:26.159+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:27.208 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:27.205+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:27.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:27.205+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:28.186 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:28.183+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:28.187 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:28.183+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:29.157 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:29.154+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:29.158 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:29.154+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:30.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:30.200+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:30.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:30.200+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:31.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:31.246+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:31.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:31.246+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:32.232 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:32.229+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:32.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:32.229+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:33.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:33.190+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:33.194 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:33.190+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:34.184 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:34.180+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:34.184 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:34.180+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:35.188 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:35.185+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:35.188 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:35.185+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:36.150 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:36.146+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:36.150 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:36.146+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:37.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:37.175+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:37.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:37.175+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:38.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:38.175+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:38.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:38.175+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:39.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:39.131+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:39.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:39.131+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:40.092 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:40.087+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:40.092 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:40.087+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:41.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:41.104+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:41.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:41.104+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:42.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:42.125+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:42.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:42.125+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:43.146 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:43.144+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:43.147 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:43.144+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:44.109 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:44.106+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:44.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:44.106+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:45.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:45.070+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:45.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:45.070+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:46.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:46.109+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:46.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:46.109+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:47.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:47.109+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:47.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:47.109+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:48.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:48.083+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:48.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:48.083+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:49.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:49.099+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:49.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:49.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:50.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:50.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:50.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:50.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:51.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:51.087+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:51.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:51.087+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:52.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:52.040+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:52.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:52.040+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:53.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:53.015+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:53.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:53.015+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:54.003 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:54.000+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:54.003 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:54.000+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:55.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:55.031+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:55.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:55.031+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:56.084 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:56.080+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:56.084 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:56.080+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:57.047 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:57.044+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:57.047 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:57.044+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:58.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:58.008+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:58.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:58.008+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:40:59.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:59.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:40:59.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:40:59.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:00.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:00.007+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:00.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:00.007+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:01.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:01.007+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:01.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:01.007+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:02.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:02.009+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:02.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:02.009+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:03.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:03.058+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:03.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:03.058+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:04.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:04.107+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:04.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:04.107+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:05.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:05.106+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:05.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:05.106+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:06.080 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:06.076+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:06.080 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:06.076+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:07.084 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:07.080+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:07.084 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:07.080+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:08.064 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:08.061+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:08.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:08.061+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:09.031 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:09.028+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:09.031 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:09.028+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:10.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:10.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:10.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:10.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:10.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:10.979+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:10.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:10.979+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:12.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:12.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:12.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:12.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:13.001 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:12.999+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:13.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:12.999+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:13.990 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:13.987+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:13.990 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:13.987+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:14.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:14.958+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:14.962 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:14.958+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:15.967 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:15.964+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:15.967 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:15.964+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:16.999 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:16.992+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:16.999 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:16.992+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:17.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:17.945+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:17.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:17.945+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:18.909 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:18.907+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:18.910 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:18.907+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:19.866 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:19.861+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:19.867 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:19.861+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:20.877 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:20.875+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:20.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:20.875+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:21.834 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:21.832+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:21.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:21.832+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:22.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:22.876+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:22.879 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:22.876+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:23.927 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:23.924+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:23.927 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:23.924+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:24.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:24.974+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:24.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:24.974+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:25.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:25.927+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:25.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:25.927+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:26.906 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:26.903+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:26.906 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:26.903+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:27.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:27.892+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:27.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:27.892+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:28.867 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:28.865+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:28.867 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:28.865+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:29.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:29.873+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:29.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:29.873+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:30.918 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:30.916+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:30.919 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:30.916+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:31.920 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:31.917+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:31.921 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:31.917+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:32.963 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:32.960+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:32.964 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:32.960+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:33.937 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:33.934+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:33.937 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:33.934+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:34.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:34.982+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:34.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:34.982+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:35.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:35.973+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:35.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:35.973+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:36.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:36.958+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:36.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:36.958+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:37.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:37.992+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:37.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:37.992+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:38.944 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:38.942+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:38.945 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:38.942+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:39.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:39.985+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:39.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:39.985+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:40.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:40.938+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:40.941 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:40.938+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:41.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:41.937+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:41.941 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:41.937+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:42.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:42.980+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:42.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:42.980+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:43.996 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:43.993+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:43.997 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:43.993+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:44.958 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:44.955+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:44.958 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:44.955+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:45.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:45.945+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:45.949 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:45.945+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:46.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:46.961+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:46.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:46.961+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:47.918 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:47.915+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:47.919 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:47.915+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:48.874 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:48.871+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:48.875 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:48.871+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:49.867 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:49.863+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:49.867 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:49.863+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:50.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:50.855+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:50.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:50.855+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:51.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:51.896+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:51.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:51.896+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:52.945 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:52.942+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:52.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:52.942+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:53.922 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:53.918+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:53.922 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:53.918+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:54.956 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:54.953+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:54.957 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:54.953+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:55.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:55.930+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:55.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:55.930+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:56.918 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:56.911+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:56.918 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:56.911+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:57.913 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:57.910+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:57.913 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:57.910+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:58.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:58.938+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:58.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:58.938+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:41:59.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:59.943+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:41:59.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:41:59.943+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:00.908 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:00.904+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:00.908 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:00.904+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:01.956 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:01.948+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:01.957 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:01.948+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:02.954 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:02.951+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:02.954 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:02.951+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:03.916 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:03.913+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:03.917 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:03.913+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:04.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:04.891+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:04.896 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:04.891+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:05.925 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:05.921+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:05.925 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:05.921+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:06.943 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:06.940+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:06.944 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:06.940+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:07.909 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:07.906+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:07.909 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:07.906+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:08.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:08.922+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:08.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:08.922+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:09.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:09.962+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:09.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:09.962+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:11.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:11.000+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:11.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:11.000+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:12.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:12.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:12.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:12.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:13.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:13.018+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:13.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:13.018+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:14.035 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:14.032+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:14.035 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:14.032+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:15.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:15.019+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:15.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:15.019+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:16.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:16.018+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:16.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:16.018+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:17.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:17.019+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:17.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:17.019+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:18.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:18.045+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:18.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:18.045+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:19.009 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:19.005+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:19.009 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:19.005+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:20.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:20.055+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:20.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:20.055+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:21.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:21.069+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:21.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:21.069+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:22.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:22.083+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:22.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:22.084+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:23.084 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:23.081+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:23.084 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:23.081+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:24.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:24.099+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:24.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:24.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:25.106 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:25.103+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:25.106 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:25.103+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:26.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:26.111+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:26.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:26.111+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:27.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:27.101+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:27.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:27.101+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:28.147 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:28.144+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:28.147 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:28.144+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:29.176 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:29.173+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:29.176 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:29.173+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:30.200 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:30.197+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:30.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:30.197+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:31.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:31.198+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:31.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:31.198+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:32.155 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:32.152+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:32.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:32.152+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:33.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:33.118+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:33.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:33.118+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:34.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:34.136+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:34.139 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:34.136+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:35.142 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:35.139+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:35.142 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:35.139+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:36.191 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:36.188+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:36.192 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:36.188+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:37.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:37.215+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:37.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:37.215+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:38.173 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:38.170+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:38.173 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:38.170+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:39.131 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:39.128+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:39.242 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:39.128+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:40.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:40.137+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:40.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:40.137+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:41.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:41.133+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:41.136 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:41.133+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:42.109 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:42.106+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:42.109 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:42.106+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:43.142 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:43.140+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:43.143 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:43.140+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:44.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:44.110+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:44.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:44.110+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:45.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:45.121+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:45.124 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:45.121+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:46.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:46.122+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:46.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:46.122+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:47.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:47.115+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:47.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:47.115+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:48.130 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:48.128+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:48.131 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:48.128+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:49.155 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:49.152+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:49.155 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:49.153+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:50.163 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:50.161+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:50.164 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:50.161+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:51.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:51.194+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:51.197 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:51.194+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:52.164 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:52.161+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:52.164 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:52.161+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:53.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:53.138+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:53.141 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:53.138+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:54.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:54.104+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:54.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:54.104+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:55.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:55.066+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:55.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:55.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:56.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:56.025+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:56.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:56.026+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:57.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:57.023+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:57.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:57.023+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:58.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:58.066+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:58.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:58.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:42:59.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:59.036+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:42:59.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:42:59.037+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:00.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:00.065+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:00.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:00.065+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:01.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:01.076+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:01.079 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:01.076+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:02.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:02.090+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:02.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:02.090+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:03.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:03.135+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:03.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:03.135+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:04.103 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:04.101+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:04.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:04.101+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:05.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:05.098+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:05.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:05.098+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:06.095 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:06.092+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:06.095 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:06.092+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:07.137 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:07.135+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:07.137 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:07.135+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:08.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:08.137+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:08.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:08.137+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:09.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:09.101+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:09.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:09.101+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:10.162 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:10.151+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:10.376 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:10.151+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:11.116 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:11.112+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:11.116 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:11.112+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:12.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:12.114+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:12.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:12.114+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:13.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:13.083+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:13.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:13.083+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:14.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:14.111+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:14.115 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:14.111+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:15.106 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:15.102+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:15.106 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:15.102+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:16.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:16.064+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:16.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:16.064+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:17.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:17.069+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:17.074 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:17.069+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:18.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:18.114+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:18.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:18.114+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:19.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:19.117+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:19.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:19.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:20.166 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:20.156+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:20.167 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:20.156+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:21.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:21.150+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:21.154 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:21.150+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:22.141 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:22.137+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:22.142 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:22.138+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:23.169 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:23.166+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:23.170 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:23.166+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:24.211 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:24.208+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:24.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:24.208+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:25.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:25.211+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:25.215 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:25.211+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:26.172 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:26.169+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:26.172 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:26.169+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:27.130 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:27.127+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:27.131 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:27.127+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:28.167 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:28.164+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:28.168 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:28.164+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:29.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:29.153+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:29.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:29.153+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:30.152 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:30.147+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:30.152 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:30.147+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:31.197 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:31.194+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:31.197 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:31.194+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:32.200 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:32.196+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:32.200 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:32.196+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:33.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:33.152+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:33.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:33.152+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:34.158 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:34.154+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:34.158 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:34.154+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:35.143 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:35.140+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:35.144 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:35.140+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:36.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:36.115+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:36.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:36.115+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:37.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:37.148+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:37.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:37.148+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:38.106 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:38.103+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:38.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:38.103+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:39.154 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:39.151+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:39.155 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:39.151+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:40.105 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:40.102+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:40.105 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:40.102+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:41.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:41.137+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:41.141 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:41.137+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:42.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:42.126+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:42.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:42.126+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:43.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:43.163+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:43.166 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:43.163+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:44.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:44.161+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:44.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:44.161+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:45.122 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:45.119+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:45.122 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:45.119+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:46.160 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:46.157+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:46.160 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:46.157+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:47.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:47.200+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:47.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:47.200+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:48.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:48.229+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:48.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:48.229+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:49.259 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:49.256+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:49.259 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:49.256+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:50.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:50.253+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:50.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:50.253+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:51.206 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:51.204+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:51.207 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:51.204+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:52.211 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:52.208+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:52.211 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:52.208+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:53.162 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:53.159+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:53.162 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:53.159+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:54.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:54.153+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:54.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:54.153+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:55.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:55.108+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:55.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:55.108+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:56.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:56.063+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:56.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:56.063+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:57.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:57.034+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:57.037 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:57.034+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:58.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:58.040+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:58.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:58.041+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:43:59.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:59.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:43:59.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:43:59.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:00.049 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:00.046+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:00.049 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:00.046+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:01.041 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:01.038+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:01.041 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:01.038+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:02.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:02.007+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:02.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:02.007+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:03.016 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:03.012+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:03.016 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:03.012+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:04.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:04.013+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:04.016 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:04.013+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:05.000 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:04.996+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:05.000 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:04.996+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:06.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:06.019+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:06.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:06.019+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:07.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:07.068+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:07.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:07.068+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:08.094 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:08.091+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:08.094 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:08.091+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:09.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:09.059+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:09.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:09.059+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:10.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:10.091+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:10.094 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:10.091+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:11.144 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:11.141+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:11.144 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:11.141+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:12.167 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:12.165+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:12.168 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:12.165+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:13.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:13.122+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:13.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:13.122+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:14.141 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:14.138+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:14.141 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:14.139+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:15.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:15.091+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:15.094 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:15.091+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:16.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:16.111+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:16.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:16.111+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:17.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:17.066+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:17.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:17.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:18.074 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:18.071+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:18.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:18.071+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:19.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:19.082+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:19.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:19.083+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:20.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:20.070+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:20.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:20.070+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:21.088 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:21.086+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:21.088 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:21.086+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:22.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:22.129+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:22.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:22.129+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:23.145 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:23.142+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:23.146 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:23.142+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:24.159 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:24.156+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:24.159 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:24.156+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:25.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:25.110+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:25.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:25.110+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:26.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:26.074+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:26.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:26.074+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:27.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:27.026+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:27.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:27.026+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:28.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:28.044+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:28.047 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:28.044+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:29.080 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:29.077+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:29.080 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:29.077+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:30.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:30.052+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:30.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:30.052+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:31.023 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:31.021+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:31.023 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:31.021+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:32.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:32.002+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:32.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:32.002+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:32.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:32.981+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:32.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:32.981+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:33.950 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:33.947+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:33.950 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:33.947+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:34.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:34.963+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:34.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:34.963+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:35.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:35.939+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:35.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:35.939+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:36.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:36.958+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:36.962 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:36.958+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:37.918 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:37.915+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:37.919 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:37.915+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:38.928 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:38.925+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:38.928 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:38.925+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:39.889 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:39.886+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:39.890 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:39.886+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:40.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:40.912+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:40.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:40.912+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:41.964 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:41.960+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:41.964 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:41.960+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:42.925 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:42.921+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:42.925 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:42.921+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:43.883 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:43.880+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:43.884 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:43.880+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:44.885 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:44.882+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:44.886 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:44.882+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:45.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:45.878+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:45.882 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:45.878+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:46.912 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:46.909+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:46.912 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:46.909+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:47.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:47.877+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:47.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:47.877+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:48.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:48.830+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:48.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:48.830+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:49.861 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:49.858+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:49.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:49.858+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:50.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:50.858+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:50.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:50.858+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:51.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:51.834+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:51.838 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:51.834+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:52.868 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:52.865+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:52.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:52.865+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:53.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:53.896+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:53.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:53.896+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:54.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:54.927+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:54.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:54.927+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:55.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:55.963+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:55.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:55.963+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:56.960 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:56.957+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:56.961 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:56.957+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:58.003 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:58.000+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:58.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:58.000+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:44:59.051 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:59.048+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:44:59.051 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:44:59.048+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:00.017 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:00.013+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:00.017 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:00.013+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:01.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:01.023+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:01.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:01.023+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:02.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:02.041+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:02.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:02.041+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:03.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:03.049+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:03.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:03.049+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:04.082 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:04.079+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:04.082 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:04.079+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:05.057 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:05.054+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:05.057 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:05.054+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:06.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:06.065+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:06.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:06.065+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:07.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:07.096+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:07.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:07.096+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:08.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:08.087+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:08.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:08.087+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:09.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:09.073+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:09.077 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:09.073+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:10.037 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:10.034+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:10.037 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:10.034+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:11.037 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:11.034+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:11.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:11.034+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:11.999 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:11.996+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:11.999 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:11.996+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:13.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:13.038+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:13.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:13.038+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:14.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:14.023+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:14.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:14.023+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:15.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:15.072+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:15.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:15.072+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:16.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:16.023+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:16.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:16.023+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:17.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:17.031+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:17.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:17.031+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:18.081 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:18.078+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:18.082 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:18.078+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:19.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:19.052+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:19.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:19.052+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:20.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:20.026+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:20.031 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:20.026+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:21.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:21.052+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:21.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:21.052+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:22.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:22.086+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:22.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:22.086+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:23.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:23.067+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:23.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:23.067+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:24.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:24.050+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:24.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:24.050+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:25.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:25.059+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:25.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:25.059+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:26.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:26.036+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:26.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:26.036+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:27.056 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:27.053+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:27.056 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:27.053+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:28.049 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:28.047+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:28.050 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:28.047+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:29.050 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:29.047+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:29.050 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:29.047+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:30.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:30.004+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:30.008 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:30.004+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:31.025 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:31.022+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:31.025 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:31.022+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:32.059 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:32.057+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:32.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:32.057+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:33.037 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:33.035+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:33.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:33.035+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:33.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:33.992+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:33.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:33.992+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:35.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:35.041+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:35.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:35.041+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:35.996 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:35.993+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:35.996 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:35.993+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:36.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:36.974+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:36.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:36.974+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:37.979 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:37.976+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:37.979 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:37.976+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:39.025 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:39.023+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:39.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:39.023+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:39.980 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:39.977+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:39.980 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:39.978+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:40.938 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:40.935+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:40.938 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:40.936+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:41.980 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:41.978+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:41.981 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:41.978+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:42.960 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:42.957+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:42.960 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:42.958+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:44.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:44.001+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:44.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:44.001+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:44.981 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:44.978+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:44.981 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:44.978+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:45.937 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:45.934+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:45.937 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:45.934+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:46.980 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:46.977+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:46.980 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:46.977+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:48.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:48.026+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:48.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:48.026+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:49.037 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:49.035+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:49.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:49.035+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:50.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:50.019+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:50.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:50.019+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:51.063 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:51.061+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:51.064 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:51.061+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:52.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:52.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:52.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:52.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:53.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:53.045+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:53.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:53.045+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:54.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:54.027+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:54.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:54.027+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:55.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:55.001+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:55.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:55.001+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:56.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:56.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:56.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:56.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:57.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:57.021+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:57.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:57.021+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:58.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:58.055+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:58.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:58.055+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:45:59.032 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:59.030+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:45:59.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:45:59.030+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:00.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:00.031+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:00.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:00.031+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:01.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:01.004+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:01.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:01.004+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:01.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:01.982+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:01.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:01.982+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:02.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:02.979+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:02.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:02.979+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:03.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:03.929+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:03.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:03.929+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:04.883 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:04.880+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:04.884 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:04.880+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:05.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:05.874+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:05.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:05.874+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:06.908 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:06.905+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:06.908 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:06.905+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:07.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:07.896+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:07.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:07.896+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:08.875 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:08.872+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:08.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:08.872+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:09.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:09.855+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:09.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:09.855+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:10.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:10.895+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:10.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:10.895+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:11.877 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:11.873+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:11.877 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:11.873+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:12.908 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:12.905+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:12.909 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:12.905+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:13.885 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:13.882+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:13.885 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:13.882+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:14.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:14.891+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:14.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:14.891+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:15.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:15.845+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:15.849 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:15.845+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:16.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:16.852+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:16.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:16.852+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:17.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:17.809+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:17.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:17.809+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:18.857 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:18.854+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:18.858 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:18.854+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:19.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:19.823+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:19.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:19.823+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:20.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:20.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:20.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:20.777+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:21.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:21.808+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:21.812 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:21.808+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:22.822 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:22.818+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:22.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:22.818+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:23.867 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:23.864+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:23.868 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:23.864+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:24.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:24.847+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:24.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:24.847+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:25.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:25.891+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:25.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:25.892+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:26.914 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:26.911+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:26.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:26.911+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:27.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:27.928+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:27.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:27.928+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:28.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:28.892+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:28.896 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:28.892+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:29.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:29.932+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:29.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:29.932+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:30.972 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:30.969+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:30.973 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:30.969+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:31.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:31.931+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:31.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:31.931+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:32.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:32.948+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:32.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:32.948+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:33.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:33.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:33.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:33.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:35.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:35.038+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:35.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:35.038+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:36.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:36.004+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:36.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:36.004+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:37.017 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:37.014+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:37.018 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:37.014+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:38.018 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:38.014+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:38.018 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:38.014+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:39.057 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:39.054+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:39.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:39.054+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:40.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:40.058+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:40.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:40.058+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:41.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:41.027+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:41.031 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:41.027+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:42.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:42.049+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:42.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:42.049+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:43.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:43.031+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:43.035 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:43.031+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:43.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:43.992+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:43.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:43.992+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:44.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:44.984+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:44.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:44.984+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:45.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:45.981+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:45.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:45.981+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:46.980 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:46.977+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:46.981 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:46.977+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:47.958 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:47.955+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:47.958 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:47.955+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:48.914 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:48.911+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:48.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:48.911+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:49.920 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:49.917+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:49.921 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:49.917+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:50.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:50.891+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:50.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:50.891+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:51.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:51.897+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:51.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:51.897+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:52.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:52.940+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:52.943 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:52.940+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:53.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:53.984+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:53.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:53.984+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:54.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:54.937+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:54.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:54.937+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:55.954 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:55.952+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:55.955 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:55.952+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:56.986 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:56.983+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:56.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:56.983+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:57.991 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:57.988+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:57.991 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:57.988+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:58.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:58.980+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:58.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:58.980+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:46:59.997 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:59.995+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:46:59.998 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:46:59.995+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:00.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:00.972+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:00.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:00.972+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:02.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:02.007+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:02.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:02.007+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:03.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:03.026+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:03.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:03.026+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:03.986 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:03.983+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:03.986 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:03.983+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:05.008 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:05.005+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:05.009 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:05.005+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:06.035 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:06.032+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:06.035 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:06.032+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:07.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:07.045+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:07.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:07.045+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:08.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:08.064+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:08.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:08.064+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:09.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:09.028+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:09.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:09.029+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:10.049 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:10.046+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:10.049 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:10.046+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:11.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:11.025+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:11.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:11.025+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:11.998 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:11.995+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:11.998 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:11.995+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:13.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:13.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:13.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:13.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:14.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:14.013+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:14.016 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:14.013+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:15.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:15.046+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:15.049 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:15.046+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:16.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:16.002+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:16.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:16.002+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:17.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:17.003+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:17.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:17.003+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:18.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:18.030+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:18.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:18.031+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:19.047 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:19.044+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:19.047 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:19.044+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:20.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:20.052+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:20.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:20.052+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:21.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:21.058+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:21.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:21.059+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:22.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:22.065+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:22.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:22.065+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:23.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:23.074+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:23.077 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:23.074+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:24.081 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:24.078+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:24.081 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:24.078+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:25.098 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:25.095+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:25.098 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:25.095+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:26.099 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:26.096+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:26.099 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:26.097+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:27.147 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:27.143+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:27.148 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:27.143+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:28.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:28.099+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:28.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:28.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:29.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:29.094+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:29.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:29.094+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:30.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:30.082+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:30.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:30.082+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:31.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:31.067+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:31.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:31.067+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:32.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:32.099+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:32.103 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:32.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:33.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:33.128+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:33.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:33.128+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:34.119 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:34.116+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:34.119 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:34.116+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:35.089 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:35.086+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:35.089 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:35.086+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:36.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:36.067+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:36.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:36.067+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:37.082 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:37.079+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:37.083 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:37.079+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:38.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:38.087+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:38.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:38.087+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:39.059 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:39.056+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:39.059 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:39.056+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:40.032 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:40.029+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:40.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:40.029+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:40.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:40.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:40.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:40.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:42.009 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:42.006+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:42.009 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:42.006+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:43.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:43.023+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:43.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:43.023+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:44.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:44.073+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:44.077 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:44.073+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:45.035 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:45.032+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:45.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:45.032+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:46.051 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:46.048+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:46.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:46.048+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:47.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:47.035+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:47.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:47.035+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:48.000 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:47.997+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:48.000 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:47.997+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:49.031 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:49.028+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:49.031 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:49.028+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:49.991 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:49.988+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:49.991 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:49.988+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:51.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:51.007+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:51.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:51.007+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:52.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:52.035+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:52.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:52.035+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:53.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:53.011+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:53.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:53.011+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:54.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:54.055+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:54.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:54.055+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:55.037 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:55.034+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:55.038 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:55.034+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:56.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:56.067+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:56.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:56.067+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:57.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:57.082+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:57.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:57.082+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:58.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:58.099+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:58.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:58.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:47:59.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:59.090+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:47:59.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:47:59.090+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:00.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:00.111+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:00.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:00.111+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:01.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:01.117+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:01.122 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:01.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:02.080 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:02.077+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:02.080 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:02.077+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:03.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:03.101+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:03.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:03.101+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:04.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:04.075+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:04.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:04.075+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:05.031 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:05.028+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:05.031 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:05.028+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:06.077 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:06.074+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:06.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:06.074+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:07.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:07.039+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:07.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:07.039+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:08.059 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:08.056+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:08.059 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:08.056+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:09.064 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:09.061+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:09.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:09.061+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:10.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:10.034+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:10.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:10.034+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:11.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:11.042+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:11.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:11.042+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:12.020 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:12.017+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:12.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:12.017+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:13.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:13.058+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:13.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:13.058+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:14.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:14.068+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:14.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:14.068+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:15.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:15.107+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:15.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:15.107+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:16.099 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:16.096+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:16.099 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:16.096+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:17.144 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:17.141+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:17.145 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:17.141+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:18.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:18.132+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:18.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:18.132+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:19.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:19.125+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:19.130 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:19.126+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:20.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:20.094+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:20.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:20.094+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:21.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:21.090+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:21.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:21.090+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:22.098 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:22.095+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:22.098 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:22.095+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:23.082 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:23.079+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:23.083 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:23.079+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:24.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:24.075+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:24.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:24.075+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:25.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:25.070+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:25.074 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:25.070+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:26.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:26.035+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:26.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:26.035+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:27.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:27.025+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:27.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:27.025+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:28.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:28.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:28.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:28.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:29.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:29.018+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:29.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:29.018+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:30.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:30.066+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:30.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:30.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:31.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:31.022+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:31.025 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:31.022+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:32.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:32.004+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:32.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:32.004+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:32.970 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:32.968+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:32.971 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:32.968+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:34.009 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:34.006+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:34.009 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:34.006+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:34.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:34.985+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:34.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:34.986+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:36.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:36.030+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:36.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:36.030+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:37.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:37.021+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:37.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:37.021+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:38.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:38.009+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:38.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:38.009+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:38.980 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:38.978+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:38.980 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:38.978+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:40.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:40.020+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:40.023 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:40.020+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:41.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:41.009+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:41.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:41.009+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:42.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:42.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:42.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:42.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:43.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:43.059+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:43.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:43.059+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:44.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:44.109+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:44.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:44.109+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:45.157 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:45.154+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:45.157 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:45.154+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:46.162 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:46.159+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:46.162 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:46.159+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:47.144 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:47.141+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:47.144 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:47.141+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:48.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:48.111+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:48.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:48.112+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:49.074 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:49.071+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:49.074 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:49.071+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:50.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:50.063+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:50.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:50.063+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:51.095 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:51.092+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:51.095 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:51.092+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:52.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:52.060+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:52.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:52.060+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:53.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:53.031+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:53.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:53.031+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:53.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:53.982+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:53.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:53.982+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:55.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:55.023+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:55.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:55.023+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:55.997 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:55.995+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:55.998 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:55.995+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:56.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:56.973+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:56.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:56.973+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:57.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:57.945+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:57.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:57.945+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:58.903 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:58.900+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:58.903 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:58.900+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:48:59.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:59.896+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:48:59.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:48:59.896+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:00.916 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:00.913+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:00.917 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:00.913+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:01.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:01.890+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:01.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:01.890+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:02.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:02.847+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:02.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:02.847+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:03.892 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:03.888+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:03.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:03.888+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:04.921 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:04.917+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:04.921 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:04.917+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:05.889 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:05.886+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:05.890 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:05.886+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:06.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:06.852+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:06.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:06.852+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:07.872 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:07.869+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:07.873 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:07.869+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:08.898 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:08.895+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:08.898 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:08.895+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:09.943 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:09.939+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:09.943 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:09.939+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:10.991 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:10.987+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:10.991 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:10.987+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:11.947 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:11.944+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:11.947 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:11.944+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:12.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:12.984+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:12.987 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:12.984+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:13.955 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:13.952+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:13.956 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:13.952+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:14.947 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:14.944+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:14.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:14.944+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:15.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:15.979+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:15.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:15.979+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:16.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:16.981+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:16.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:16.981+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:18.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:18.020+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:18.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:18.020+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:18.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:18.985+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:18.989 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:18.985+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:19.969 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:19.966+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:19.970 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:19.966+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:20.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:20.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:20.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:20.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:21.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:21.981+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:21.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:21.981+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:23.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:23.004+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:23.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:23.004+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:24.018 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:24.015+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:24.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:24.015+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:24.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:24.980+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:24.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:24.980+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:25.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:25.948+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:25.952 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:25.948+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:26.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:26.913+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:26.916 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:26.913+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:27.913 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:27.909+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:27.913 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:27.910+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:28.910 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:28.906+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:28.910 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:28.906+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:29.922 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:29.919+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:29.922 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:29.919+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:30.934 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:30.931+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:30.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:30.931+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:31.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:31.948+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:31.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:31.948+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:32.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:32.971+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:32.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:32.971+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:33.943 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:33.940+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:33.943 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:33.940+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:34.955 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:34.949+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:34.955 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:34.949+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:36.000 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:35.997+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:36.000 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:35.997+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:36.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:36.971+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:36.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:36.971+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:38.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:38.001+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:38.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:38.001+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:39.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:39.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:39.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:39.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:39.992 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:39.989+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:39.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:39.989+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:40.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:40.963+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:40.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:40.963+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:41.969 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:41.966+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:41.969 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:41.966+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:42.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:42.991+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:42.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:42.991+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:44.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:44.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:44.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:44.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:44.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:44.973+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:44.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:44.973+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:45.968 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:45.965+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:45.968 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:45.965+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:46.979 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:46.977+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:46.980 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:46.977+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:48.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:48.002+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:48.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:48.002+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:48.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:48.960+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:48.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:48.960+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:49.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:49.961+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:49.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:49.961+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:50.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:50.972+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:50.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:50.972+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:51.944 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:51.941+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:51.944 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:51.941+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:52.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:52.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:52.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:52.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:53.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:53.971+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:53.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:53.971+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:54.997 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:54.995+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:54.998 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:54.995+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:55.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:55.980+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:55.984 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:55.980+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:57.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:57.001+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:57.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:57.001+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:58.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:58.041+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:58.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:58.041+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:59.001 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:58.998+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:59.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:58.998+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:49:59.954 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:59.952+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:49:59.955 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:49:59.952+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:00.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:00.926+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:00.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:00.926+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:01.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:01.932+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:01.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:01.932+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:02.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:02.945+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:02.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:02.945+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:03.947 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:03.943+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:03.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:03.943+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:04.956 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:04.954+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:04.957 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:04.954+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:05.926 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:05.913+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:05.926 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:05.913+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:06.943 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:06.940+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:06.944 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:06.941+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:07.935 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:07.933+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:07.936 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:07.933+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:08.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:08.949+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:08.952 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:08.949+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:09.939 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:09.936+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:09.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:09.936+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:10.922 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:10.919+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:10.922 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:10.919+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:11.917 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:11.915+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:11.917 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:11.915+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:12.952 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:12.950+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:12.953 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:12.950+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:13.957 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:13.954+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:13.957 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:13.954+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:15.004 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:15.002+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:15.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:15.002+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:15.988 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:15.986+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:15.989 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:15.986+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:17.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:17.017+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:17.020 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:17.017+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:17.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:17.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:17.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:17.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:18.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:18.974+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:18.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:18.974+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:19.950 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:19.947+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:19.950 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:19.947+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:20.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:20.929+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:20.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:20.929+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:21.978 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:21.973+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:21.979 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:21.973+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:22.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:22.927+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:22.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:22.927+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:23.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:23.892+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:23.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:23.892+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:24.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:24.930+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:24.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:24.930+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:25.919 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:25.917+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:25.919 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:25.917+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:26.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:26.898+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:26.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:26.898+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:27.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:27.866+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:27.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:27.866+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:28.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:28.851+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:28.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:28.851+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:29.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:29.824+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:29.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:29.824+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:30.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:30.809+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:30.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:30.809+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:31.811 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:31.808+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:31.811 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:31.808+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:32.853 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:32.850+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:32.854 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:32.850+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:33.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:33.847+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:33.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:33.847+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:34.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:34.805+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:34.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:34.805+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:35.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:35.806+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:40:04.252184+0000 (oldest deadline 2020-06-27T05:40:24.252184+0000) 2020-06-27T05:50:35.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:35.806+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:36.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:36.787+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:37.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:37.745+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:38.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:38.700+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:39.667 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:39.664+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:40.672 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:40.668+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:41.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:41.717+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:42.770 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:42.756+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:43.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:43.717+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:44.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:44.727+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:45.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:45.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:46.715 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:46.712+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:47.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:47.737+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:48.721 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:48.718+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:49.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:49.699+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:50.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:50.652+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:51.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:51.611+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:52.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:52.645+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:53.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:53.674+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:54.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:54.640+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:55.665 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:55.662+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:56.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:56.705+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:57.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:57.739+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:58.718 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:58.715+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:50:59.691 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:59.688+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:50:59.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:50:59.688+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:00.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:00.689+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:00.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:00.689+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:01.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:01.704+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:01.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:01.704+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:02.699 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:02.696+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:02.699 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:02.696+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:03.656 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:03.653+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:03.656 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:03.653+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:04.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:04.683+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:04.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:04.683+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:05.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:05.645+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:05.649 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:05.645+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:06.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:06.639+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:06.642 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:06.639+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:07.673 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:07.670+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:07.674 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:07.670+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:08.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:08.689+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:08.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:08.689+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:09.659 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:09.655+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:09.659 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:09.655+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:10.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:10.634+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:10.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:10.634+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:11.659 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:11.655+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:11.660 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:11.656+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:12.676 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:12.673+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:12.677 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:12.673+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:13.629 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:13.626+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:13.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:13.626+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:14.650 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:14.646+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:14.650 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:14.646+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:15.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:15.637+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:15.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:15.637+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:16.624 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:16.621+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:16.625 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:16.621+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:17.673 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:17.670+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:17.674 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:17.670+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:18.695 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:18.692+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:18.696 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:18.692+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:19.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:19.719+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:19.722 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:19.719+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:20.699 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:20.697+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:20.700 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:20.697+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:21.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:21.726+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:21.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:21.726+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:22.737 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:22.734+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:22.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:22.734+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:23.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:23.717+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:23.720 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:23.717+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:24.757 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:24.755+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:24.758 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:24.755+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:25.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:25.771+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:25.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:25.771+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:26.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:26.761+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:26.764 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:26.761+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:27.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:27.797+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:27.801 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:27.797+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:28.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:28.797+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:28.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:28.797+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:29.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:29.762+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:29.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:29.762+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:30.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:30.734+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:30.738 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:30.734+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:31.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:31.736+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:31.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:31.737+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:32.700 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:32.698+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:32.701 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:32.698+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:33.690 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:33.688+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:33.691 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:33.688+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:34.689 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:34.686+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:34.689 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:34.686+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:35.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:35.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:35.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:35.728+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:36.708 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:36.704+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:36.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:36.704+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:37.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:37.704+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:37.707 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:37.704+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:38.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:38.741+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:38.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:38.741+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:39.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:39.710+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:39.713 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:39.710+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:40.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:40.684+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:40.687 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:40.684+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:41.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:41.691+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:41.693 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:41.691+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:42.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:42.708+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:42.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:42.708+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:43.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:43.707+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:43.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:43.707+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:44.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:44.668+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:44.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:44.668+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:45.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:45.703+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:45.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:45.703+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:46.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:46.708+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:46.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:46.708+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:47.701 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:47.698+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:47.701 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:47.698+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:48.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:48.741+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:48.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:48.741+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:49.718 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:49.716+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:49.719 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:49.716+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:50.736 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:50.734+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:50.737 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:50.734+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:51.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:51.737+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:51.740 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:51.737+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:52.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:52.783+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:52.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:52.783+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:53.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:53.770+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:53.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:53.770+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:54.760 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:54.757+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:54.760 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:54.757+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:55.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:55.793+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:55.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:55.793+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:56.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:56.823+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:56.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:56.823+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:57.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:57.810+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:57.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:57.810+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:58.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:58.843+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:58.846 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:58.843+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:51:59.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:59.820+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:51:59.823 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:51:59.820+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:00.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:00.809+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:00.813 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:00.809+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:01.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:01.853+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:01.857 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:01.853+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:02.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:02.852+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:02.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:02.852+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:03.834 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:03.830+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:03.834 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:03.830+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:04.875 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:04.872+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:04.875 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:04.872+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:05.905 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:05.901+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:05.905 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:05.901+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:06.941 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:06.938+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:06.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:06.938+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:07.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:07.937+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:07.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:07.937+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:08.979 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:08.976+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:08.980 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:08.976+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:09.952 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:09.949+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:09.952 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:09.949+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:10.955 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:10.952+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:10.956 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:10.952+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:11.974 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:11.971+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:11.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:11.971+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:12.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:12.981+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:12.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:12.981+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:13.938 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:13.935+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:13.938 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:13.935+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:14.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:14.972+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:14.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:14.972+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:16.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:16.015+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:16.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:16.016+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:16.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:16.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:16.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:16.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:18.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:18.039+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:18.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:18.039+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:19.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:19.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:19.028 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:19.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:20.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:20.016+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:20.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:20.016+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:21.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:21.009+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:21.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:21.009+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:21.979 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:21.976+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:21.979 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:21.976+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:22.969 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:22.966+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:22.969 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:22.966+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:23.958 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:23.955+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:23.958 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:23.955+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:24.967 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:24.964+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:24.967 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:24.964+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:25.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:25.973+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:25.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:25.973+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:26.964 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:26.961+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:26.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:26.961+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:27.941 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:27.937+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:27.941 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:27.937+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:28.932 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:28.929+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:28.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:28.929+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:29.958 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:29.955+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:29.958 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:29.955+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:30.999 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:30.996+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:30.999 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:30.996+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:31.955 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:31.952+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:31.955 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:31.952+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:32.928 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:32.925+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:32.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:32.925+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:33.945 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:33.942+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:33.946 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:33.942+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:34.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:34.979+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:34.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:34.979+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:35.981 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:35.978+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:35.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:35.978+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:37.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:37.019+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:37.022 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:37.019+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:38.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:38.015+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:38.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:38.015+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:38.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:38.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:38.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:38.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:40.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:40.009+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:40.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:40.009+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:41.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:41.057+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:41.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:41.057+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:42.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:42.062+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:42.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:42.062+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:43.040 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:43.037+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:43.040 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:43.037+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:44.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:44.005+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:44.008 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:44.005+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:44.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:44.991+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:44.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:44.991+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:45.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:45.980+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:45.983 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:45.980+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:46.954 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:46.952+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:46.955 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:46.952+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:47.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:47.926+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:47.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:47.926+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:48.882 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:48.879+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:48.882 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:48.879+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:49.918 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:49.915+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:49.918 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:49.915+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:50.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:50.867+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:50.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:50.867+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:51.866 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:51.863+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:51.866 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:51.863+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:52.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:52.900+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:52.903 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:52.900+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:53.924 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:53.922+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:53.925 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:53.922+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:54.892 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:54.890+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:54.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:54.890+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:55.887 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:55.884+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:55.887 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:55.884+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:56.876 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:56.874+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:56.877 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:56.874+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:57.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:57.899+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:57.902 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:57.899+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:58.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:58.931+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:58.934 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:58.931+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:52:59.963 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:59.961+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:52:59.964 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:52:59.961+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:00.955 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:00.953+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:00.956 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:00.953+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:01.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:01.973+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:01.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:01.973+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:02.960 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:02.957+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:02.960 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:02.957+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:04.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:04.004+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:04.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:04.004+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:05.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:05.033+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:05.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:05.033+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:06.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:06.035+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:06.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:06.035+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:06.994 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:06.992+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:06.995 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:06.992+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:08.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:08.018+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:08.021 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:08.018+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:09.057 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:09.054+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:09.057 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:09.054+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:10.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:10.060+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:10.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:10.060+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:11.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:11.024+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:11.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:11.024+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:12.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:12.026+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:12.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:12.026+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:13.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:12.999+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:13.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:12.999+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:13.979 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:13.976+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:13.979 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:13.976+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:14.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:14.963+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:14.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:14.963+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:15.999 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:15.995+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:15.999 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:15.995+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:17.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:17.033+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:17.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:17.033+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:18.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:18.075+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:18.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:18.075+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:19.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:19.123+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:19.126 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:19.123+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:20.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:20.083+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:20.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:20.084+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:21.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:21.083+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:21.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:21.083+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:22.103 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:22.101+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:22.104 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:22.101+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:23.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:23.058+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:23.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:23.058+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:24.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:24.090+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:24.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:24.090+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:25.127 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:25.123+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:25.128 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:25.123+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:26.139 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:26.136+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:26.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:26.136+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:27.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:27.108+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:27.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:27.108+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:28.074 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:28.070+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:28.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:28.070+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:29.050 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:29.046+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:29.050 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:29.046+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:30.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:30.003+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:30.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:30.003+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:31.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:31.008+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:31.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:31.008+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:32.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:32.000+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:32.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:32.000+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:32.999 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:32.995+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:32.999 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:32.995+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:34.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:34.012+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:34.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:34.012+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:35.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:35.060+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:35.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:35.060+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:36.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:36.094+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:36.098 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:36.094+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:37.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:37.118+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:37.122 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:37.118+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:38.154 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:38.151+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:38.155 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:38.151+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:39.118 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:39.115+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:39.119 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:39.115+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:40.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:40.089+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:40.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:40.089+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:41.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:41.066+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:41.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:41.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:42.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:42.114+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:42.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:42.114+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:43.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:43.120+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:43.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:43.120+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:44.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:44.088+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:44.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:44.088+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:45.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:45.087+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:45.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:45.087+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:46.116 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:46.113+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:46.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:46.113+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:47.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:47.093+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:47.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:47.093+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:48.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:48.116+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:48.130 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:48.116+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:49.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:49.149+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:49.153 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:49.149+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:50.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:50.190+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:50.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:50.190+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:51.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:51.193+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:51.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:51.193+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:52.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:52.240+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:52.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:52.240+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:53.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:53.206+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:53.210 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:53.206+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:54.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:54.247+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:54.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:54.247+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:55.229 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:55.224+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:55.229 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:55.224+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:56.228 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:56.225+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:56.228 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:56.225+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:57.192 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:57.189+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:57.192 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:57.189+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:58.224 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:58.221+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:58.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:58.221+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:53:59.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:59.216+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:53:59.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:53:59.216+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:00.200 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:00.197+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:00.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:00.197+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:01.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:01.244+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:01.248 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:01.244+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:02.228 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:02.225+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:02.228 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:02.225+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:03.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:03.216+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:03.219 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:03.216+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:04.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:04.232+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:04.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:04.232+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:05.255 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:05.252+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:05.255 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:05.252+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:06.244 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:06.241+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:06.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:06.241+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:07.268 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:07.265+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:07.268 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:07.265+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:08.226 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:08.223+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:08.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:08.223+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:09.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:09.198+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:09.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:09.198+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:10.189 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:10.186+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:10.189 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:10.186+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:11.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:11.224+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:11.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:11.224+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:12.206 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:12.203+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:12.206 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:12.203+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:13.156 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:13.153+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:13.157 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:13.153+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:14.133 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:14.131+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:14.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:14.131+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:15.167 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:15.163+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:15.167 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:15.163+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:16.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:16.120+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:16.124 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:16.120+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:17.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:17.089+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:17.094 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:17.090+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:18.081 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:18.078+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:18.082 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:18.078+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:19.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:19.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:19.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:19.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:20.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:20.065+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:20.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:20.065+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:21.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:21.064+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:21.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:21.064+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:22.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:22.071+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:22.074 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:22.071+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:23.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:23.037+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:23.040 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:23.037+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:24.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:24.058+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:24.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:24.058+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:25.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:25.041+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:25.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:25.041+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:26.040 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:26.038+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:26.041 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:26.038+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:27.050 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:27.048+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:27.051 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:27.048+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:28.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:28.016+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:28.020 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:28.016+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:29.051 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:29.049+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:29.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:29.049+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:30.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:30.040+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:30.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:30.040+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:31.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:31.036+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:31.040 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:31.037+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:32.081 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:32.078+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:32.082 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:32.079+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:33.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:33.058+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:33.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:33.058+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:34.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:34.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:34.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:34.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:34.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:34.975+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:34.978 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:34.975+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:36.023 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:36.020+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:36.023 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:36.020+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:37.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:37.063+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:37.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:37.063+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:38.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:38.069+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:38.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:38.069+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:39.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:39.098+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:39.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:39.098+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:40.145 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:40.143+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:40.146 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:40.143+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:41.172 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:41.170+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:41.173 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:41.170+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:42.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:42.173+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:42.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:42.173+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:43.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:43.172+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:43.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:43.172+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:44.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:44.173+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:44.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:44.173+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:45.176 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:45.174+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:45.177 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:45.174+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:46.226 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:46.224+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:46.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:46.224+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:47.197 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:47.195+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:47.197 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:47.195+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:48.190 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:48.187+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:48.191 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:48.187+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:49.146 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:49.143+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:49.146 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:49.143+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:50.103 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:50.099+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:50.103 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:50.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:51.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:51.135+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:51.139 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:51.135+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:52.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:52.109+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:52.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:52.109+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:53.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:53.103+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:53.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:53.103+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:54.127 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:54.124+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:54.127 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:54.124+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:55.128 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:55.125+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:55.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:55.125+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:56.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:56.082+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:56.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:56.082+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:57.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:57.109+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:57.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:57.109+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:58.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:58.126+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:58.130 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:58.126+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:54:59.094 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:59.091+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:54:59.095 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:54:59.091+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:00.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:00.105+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:00.109 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:00.105+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:01.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:01.057+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:01.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:01.057+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:02.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:02.019+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:02.025 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:02.019+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:02.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:02.982+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:02.986 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:02.982+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:03.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:03.974+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:03.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:03.974+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:04.970 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:04.967+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:04.971 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:04.967+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:06.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:06.016+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:06.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:06.016+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:07.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:07.021+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:07.025 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:07.021+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:07.989 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:07.986+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:07.990 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:07.986+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:08.973 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:08.970+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:08.973 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:08.970+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:09.938 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:09.935+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:09.939 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:09.935+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:10.912 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:10.909+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:10.912 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:10.909+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:11.866 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:11.863+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:11.867 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:11.863+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:12.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:12.889+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:12.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:12.889+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:13.930 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:13.927+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:13.931 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:13.927+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:14.913 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:14.910+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:14.914 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:14.910+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:15.947 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:15.944+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:15.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:15.944+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:16.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:16.926+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:16.929 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:16.926+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:17.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:17.890+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:17.893 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:17.890+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:18.881 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:18.878+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:18.882 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:18.878+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:19.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:19.912+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:19.915 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:19.912+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:20.964 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:20.961+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:20.964 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:20.961+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:21.965 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:21.962+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:21.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:21.962+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:23.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:23.012+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:23.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:23.012+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:24.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:24.048+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:24.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:24.048+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:25.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:25.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:25.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:25.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:26.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:26.003+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:26.006 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:26.003+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:26.997 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:26.995+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:26.998 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:26.995+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:28.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:28.045+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:28.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:28.045+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:29.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:29.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:29.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:29.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:30.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:30.008+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:30.012 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:30.008+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:30.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:30.972+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:30.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:30.972+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:32.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:32.000+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:32.003 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:32.000+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:33.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:33.026+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:33.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:33.026+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:34.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:34.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:34.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:34.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:35.047 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:35.045+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:35.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:35.045+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:36.024 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:36.021+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:36.025 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:36.021+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:37.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:37.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:37.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:37.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:38.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:38.030+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:38.033 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:38.030+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:39.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:39.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:39.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:39.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:40.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:40.050+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:40.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:40.050+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:41.092 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:41.089+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:41.092 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:41.089+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:42.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:42.109+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:42.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:42.109+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:43.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:43.089+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:43.093 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:43.089+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:44.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:44.087+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:44.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:44.087+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:45.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:45.040+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:45.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:45.040+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:46.081 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:46.079+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:46.082 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:46.079+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:47.034 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:47.032+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:47.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:47.032+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:48.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:48.011+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:48.014 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:48.011+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:49.040 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:49.038+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:49.041 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:49.038+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:50.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:50.040+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:50.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:50.040+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:51.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:51.040+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:51.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:51.040+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:52.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:52.073+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:52.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:52.073+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:53.043 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:53.041+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:53.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:53.041+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:54.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:54.041+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:54.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:54.041+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:55.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:55.065+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:55.068 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:55.065+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:56.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:56.076+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:56.079 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:56.076+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:57.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:57.120+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:57.123 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:57.120+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:58.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:58.118+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:58.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:58.118+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:55:59.144 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:59.142+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:55:59.145 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:55:59.142+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:00.154 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:00.152+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:00.155 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:00.152+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:01.192 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:01.190+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:01.193 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:01.190+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:02.232 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:02.230+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:02.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:02.230+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:03.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:03.256+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:03.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:03.256+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:04.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:04.248+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:04.251 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:04.248+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:05.222 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:05.219+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:05.222 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:05.219+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:06.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:06.247+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:06.251 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:06.248+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:07.270 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:07.267+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:07.270 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:07.267+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:08.312 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:08.310+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:08.313 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:08.310+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:09.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:09.336+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:09.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:09.336+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:10.291 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:10.288+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:10.291 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:10.288+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:11.284 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:11.282+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:11.285 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:11.282+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:12.332 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:12.330+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:12.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:12.330+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:13.319 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:13.315+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:13.319 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:13.315+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:14.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:14.343+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:14.347 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:14.343+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:15.386 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:15.383+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:15.387 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:15.383+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:16.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:16.341+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:16.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:16.341+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:17.315 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:17.312+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:17.316 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:17.312+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:18.293 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:18.290+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:18.294 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:18.290+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:19.264 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:19.260+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:19.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:19.260+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:20.241 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:20.237+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:20.241 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:20.237+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:21.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:21.243+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:21.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:21.243+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:22.210 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:22.207+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:22.211 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:22.207+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:23.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:23.253+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:23.257 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:23.253+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:24.249 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:24.246+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:24.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:24.246+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:25.229 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:25.225+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:25.229 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:25.225+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:26.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:26.192+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:26.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:26.192+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:27.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:27.222+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:27.227 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:27.222+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:28.223 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:28.220+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:28.223 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:28.220+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:29.234 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:29.231+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:29.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:29.231+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:30.242 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:30.239+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:30.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:30.239+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:31.252 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:31.249+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:31.252 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:31.249+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:32.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:32.201+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:32.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:32.201+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:33.217 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:33.213+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:33.217 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:33.213+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:34.181 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:34.177+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:34.181 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:34.177+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:35.200 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:35.197+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:35.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:35.197+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:36.160 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:36.157+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:36.160 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:36.157+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:37.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:37.125+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:37.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:37.125+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:38.126 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:38.123+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:38.126 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:38.123+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:39.152 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:39.148+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:39.152 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:39.148+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:40.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:40.197+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:40.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:40.197+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:41.190 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:41.187+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:41.191 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:41.187+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:42.208 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:42.205+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:42.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:42.205+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:43.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:43.233+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:43.237 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:43.233+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:44.275 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:44.272+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:44.275 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:44.272+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:45.302 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:45.299+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:45.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:45.299+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:46.278 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:46.275+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:46.278 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:46.275+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:47.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:47.303+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:47.307 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:47.303+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:48.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:48.302+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:48.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:48.302+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:49.294 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:49.291+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:49.294 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:49.291+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:50.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:50.331+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:50.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:50.331+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:51.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:51.351+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:51.354 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:51.351+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:52.328 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:52.325+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:52.329 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:52.325+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:53.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:53.331+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:53.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:53.331+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:54.343 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:54.341+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:54.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:54.341+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:55.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:55.354+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:55.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:55.354+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:56.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:56.333+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:56.339 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:56.333+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:57.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:57.349+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:57.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:57.349+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:58.331 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:58.328+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:58.332 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:58.328+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:56:59.286 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:59.283+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:56:59.287 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:56:59.283+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:00.266 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:00.263+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:00.267 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:00.263+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:01.296 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:01.294+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:01.297 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:01.294+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:02.252 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:02.249+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:02.253 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:02.249+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:03.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:03.252+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:03.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:03.252+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:04.248 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:04.246+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:04.249 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:04.246+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:05.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:05.230+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:05.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:05.230+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:06.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:06.199+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:06.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:06.199+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:07.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:07.176+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:07.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:07.176+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:08.208 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:08.204+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:08.208 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:08.204+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:09.176 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:09.173+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:09.177 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:09.173+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:10.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:10.132+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:10.136 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:10.132+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:11.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:11.135+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:11.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:11.135+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:12.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:12.099+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:12.102 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:12.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:13.144 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:13.141+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:13.145 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:13.141+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:14.099 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:14.097+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:14.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:14.097+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:15.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:15.093+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:15.097 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:15.093+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:16.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:16.122+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:16.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:16.122+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:17.157 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:17.154+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:17.157 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:17.154+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:18.143 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:18.140+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:18.143 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:18.140+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:19.170 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:19.167+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:19.170 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:19.167+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:20.161 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:20.158+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:20.161 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:20.158+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:21.208 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:21.206+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:21.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:21.206+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:22.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:22.253+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:22.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:22.253+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:23.290 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:23.287+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:23.291 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:23.288+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:24.280 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:24.278+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:24.281 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:24.278+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:25.267 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:25.264+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:25.267 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:25.264+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:26.222 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:26.219+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:26.222 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:26.220+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:27.229 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:27.227+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:27.230 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:27.227+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:28.226 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:28.223+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:28.226 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:28.223+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:29.183 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:29.180+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:29.183 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:29.180+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:30.199 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:30.197+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:30.200 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:30.197+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:31.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:31.193+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:31.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:31.193+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:32.228 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:32.226+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:32.229 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:32.226+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:33.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:33.210+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:33.213 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:33.210+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:34.220 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:34.218+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:34.220 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:34.218+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:35.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:35.210+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:35.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:35.210+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:36.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:36.234+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:36.237 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:36.234+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:37.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:37.234+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:37.236 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:37.234+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:38.198 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:38.195+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:38.198 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:38.195+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:39.158 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:39.154+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:39.159 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:39.155+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:40.148 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:40.145+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:40.149 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:40.145+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:41.106 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:41.103+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:41.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:41.103+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:42.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:42.066+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:42.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:42.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:43.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:43.059+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:43.063 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:43.059+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:44.084 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:44.081+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:44.085 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:44.081+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:45.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:45.106+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:45.110 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:45.106+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:46.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:46.067+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:46.071 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:46.067+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:47.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:47.050+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:47.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:47.050+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:48.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:48.025+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:48.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:48.025+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:49.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:49.050+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:49.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:49.050+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:50.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:50.062+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:50.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:50.062+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:51.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:51.023+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:51.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:51.023+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:52.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:52.070+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:52.073 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:52.070+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:53.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:53.085+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:53.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:53.085+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:54.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:54.122+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:54.125 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:54.122+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:55.174 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:55.171+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:55.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:55.171+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:56.160 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:56.157+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:56.161 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:56.157+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:57.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:57.110+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:57.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:57.110+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:58.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:58.103+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:58.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:58.104+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:57:59.107 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:59.104+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:57:59.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:57:59.104+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:00.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:00.074+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:00.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:00.074+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:01.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:01.033+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:01.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:01.033+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:02.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:02.063+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:02.067 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:02.063+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:03.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:03.045+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:03.049 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:03.045+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:04.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:04.003+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:04.008 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:04.003+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:05.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:05.044+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:05.048 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:05.044+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:06.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:06.043+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:06.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:06.043+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:07.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:06.998+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:07.002 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:06.998+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:07.975 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:07.972+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:07.976 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:07.972+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:08.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:08.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:08.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:08.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:10.040 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:10.037+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:10.041 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:10.037+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:11.069 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:11.066+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:11.070 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:11.066+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:12.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:12.049+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:12.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:12.049+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:13.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:13.043+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:13.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:13.043+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:14.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:14.058+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:14.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:14.058+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:15.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:15.010+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:15.013 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:15.010+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:16.007 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:16.004+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:16.008 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:16.004+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:17.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:17.050+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:17.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:17.050+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:18.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:18.083+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:18.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:18.083+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:19.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:19.068+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:19.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:19.068+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:20.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:20.097+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:20.101 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:20.097+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:21.098 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:21.095+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:21.098 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:21.095+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:22.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:22.073+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:22.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:22.073+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:23.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:23.074+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:23.077 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:23.074+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:24.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:24.093+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:24.096 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:24.093+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:25.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:25.111+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:25.114 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:25.111+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:26.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:26.136+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:26.139 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:26.136+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:27.149 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:27.146+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:27.150 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:27.146+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:28.111 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:28.108+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:28.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:28.108+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:29.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:29.117+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:29.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:29.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:30.133 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:30.130+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:30.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:30.130+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:31.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:31.129+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:31.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:31.129+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:32.168 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:32.165+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:32.169 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:32.165+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:33.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:33.211+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:33.214 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:33.211+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:34.228 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:34.225+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:34.229 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:34.225+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:35.255 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:35.253+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:35.256 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:35.253+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:36.254 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:36.251+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:36.254 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:36.251+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:37.224 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:37.222+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:37.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:37.222+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:38.266 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:38.263+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:38.266 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:38.263+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:39.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:39.302+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:39.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:39.302+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:40.262 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:40.259+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:40.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:40.259+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:41.291 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:41.288+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:41.292 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:41.289+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:42.282 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:42.279+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:42.282 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:42.279+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:43.304 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:43.301+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:43.304 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:43.301+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:44.334 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:44.332+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:44.335 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:44.332+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:45.297 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:45.295+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:45.298 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:45.295+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:46.325 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:46.322+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:46.325 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:46.323+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:47.331 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:47.328+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:47.331 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:47.329+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:48.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:48.301+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:48.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:48.301+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:49.304 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:49.302+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:49.305 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:49.302+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:50.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:50.255+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:50.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:50.255+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:51.244 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:51.241+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:51.244 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:51.241+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:52.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:52.199+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:52.202 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:52.199+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:53.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:53.200+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:53.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:53.200+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:54.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:54.176+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:54.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:54.176+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:55.175 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:55.173+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:55.176 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:55.173+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:56.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:56.149+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:56.152 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:56.149+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:57.179 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:57.176+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:57.180 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:57.177+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:58.164 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:58.162+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:58.165 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:58.162+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:58:59.206 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:59.204+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:58:59.207 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:58:59.204+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:00.180 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:00.177+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:00.180 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:00.177+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:01.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:01.198+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:01.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:01.198+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:02.222 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:02.219+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:02.222 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:02.219+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:03.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:03.209+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:03.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:03.209+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:04.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:04.209+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:04.212 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:04.209+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:05.220 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:05.217+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:05.220 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:05.217+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:06.171 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:06.167+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:06.171 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:06.167+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:07.202 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:07.199+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:07.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:07.199+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:08.203 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:08.200+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:08.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:08.200+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:09.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:09.200+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:09.204 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:09.200+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:10.198 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:10.195+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:10.199 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:10.195+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:11.198 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:11.194+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:11.198 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:11.194+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:12.172 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:12.169+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:12.173 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:12.169+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:13.199 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:13.196+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:13.200 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:13.196+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:14.180 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:14.176+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:14.180 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:14.176+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:15.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:15.131+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:15.135 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:15.131+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:16.099 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:16.096+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:16.100 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:16.096+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:17.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:17.117+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:17.121 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:17.117+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:18.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:18.131+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:18.134 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:18.131+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:19.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:19.148+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:19.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:19.148+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:20.139 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:20.135+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:20.139 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:20.135+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:21.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:21.148+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:21.151 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:21.148+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:22.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:22.134+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:22.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:22.134+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:23.089 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:23.086+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:23.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:23.086+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:24.074 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:24.071+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:24.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:24.071+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:25.103 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:25.099+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:25.103 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:25.099+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:26.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:26.073+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:26.077 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:26.073+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:27.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:27.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:27.055 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:27.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:28.081 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:28.078+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:28.082 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:28.078+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:29.060 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:29.057+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:29.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:29.057+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:30.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:30.049+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:30.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:30.049+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:31.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:31.007+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:31.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:31.007+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:32.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:32.001+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:32.005 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:32.001+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:33.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:33.041+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:33.044 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:33.041+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:34.065 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:34.062+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:34.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:34.062+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:35.052 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:35.049+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:35.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:35.049+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:36.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:36.084+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:36.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:36.084+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:37.061 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:37.058+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:37.062 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:37.058+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:38.054 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:38.051+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:38.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:38.051+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:39.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:39.069+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:39.072 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:39.069+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:40.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:40.036+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:40.039 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:40.036+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:41.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:41.007+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:41.010 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:41.007+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:41.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:41.979+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:41.982 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:41.979+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:42.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:42.945+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:42.949 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:42.945+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:43.928 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:43.925+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:43.928 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:43.925+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:44.954 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:44.950+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:44.954 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:44.950+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:45.963 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:45.960+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:45.963 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:45.960+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:46.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:46.982+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:46.985 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:46.982+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:47.972 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:47.969+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:47.972 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:47.969+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:48.934 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:48.929+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:48.934 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:48.929+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:49.978 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:49.975+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:49.979 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:49.975+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:50.990 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:50.987+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:50.990 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:50.987+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:52.037 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:52.033+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:52.037 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:52.033+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:52.997 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:52.995+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:52.998 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:52.995+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:53.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:53.961+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:53.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:53.961+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:54.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:54.963+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:54.966 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:54.963+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:55.941 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:55.938+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:55.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:55.938+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:56.949 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:56.945+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:56.949 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:56.945+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:57.941 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:57.937+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:57.942 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:57.937+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:58.971 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:58.968+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:58.971 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:58.968+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T05:59:59.962 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:59.959+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T05:59:59.963 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T05:59:59.959+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:00.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:00.990+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:00.993 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:00.990+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:01.950 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:01.947+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:01.951 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:01.947+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:02.940 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:02.936+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:02.941 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:02.936+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:03.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:03.896+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:03.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:03.896+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:04.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:04.908+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:04.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:04.908+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:05.895 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:05.892+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:05.896 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:05.892+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:06.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:06.861+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:06.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:06.861+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:07.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:07.813+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:07.816 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:07.813+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:08.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:08.825+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:08.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:08.825+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:09.806 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:09.802+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:09.806 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:09.802+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:10.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:10.834+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:10.837 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:10.834+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:11.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:11.877+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:11.880 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:11.877+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:12.910 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:12.907+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:12.910 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:12.907+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:13.904 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:13.901+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:13.904 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:13.901+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:14.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:14.856+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:14.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:14.857+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:15.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:15.833+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:15.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:15.833+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:16.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:16.791+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:16.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:16.791+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:17.777 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:17.770+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:17.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:17.770+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:18.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:18.724+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:18.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:18.724+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:19.678 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:19.676+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:19.679 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:19.676+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:20.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:20.630+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:20.633 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:20.630+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:21.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:21.632+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:21.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:21.632+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:22.586 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:22.583+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:22.586 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:22.583+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:23.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:23.574+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:23.577 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:23.574+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:24.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:24.561+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:24.564 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:24.561+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:25.520 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:25.518+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:25.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:25.518+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:26.566 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:26.563+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:26.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:26.563+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:27.610 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:27.608+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:27.610 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:27.608+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:28.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:28.645+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:28.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:28.645+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:29.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:29.638+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:29.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:29.638+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:30.661 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:30.659+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:30.662 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:30.659+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:31.647 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:31.644+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:31.648 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:31.644+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:32.612 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:32.608+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:32.612 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:32.608+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:33.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:33.560+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:33.564 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:33.560+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:34.602 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:34.599+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:34.603 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:34.599+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:35.611 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:35.608+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:35.611 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:35.608+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:36.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:36.628+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:36.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:36.628+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:37.605 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:37.602+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:37.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:37.602+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:38.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:38.586+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:38.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:38.586+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:39.553 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:39.549+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:39.553 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:39.549+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:40.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:40.512+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:40.516 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:40.512+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:41.529 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:41.526+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:41.530 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:41.526+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:42.503 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:42.500+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:42.504 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:42.500+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:43.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:43.476+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:43.480 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:43.476+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:44.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:44.441+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:44.445 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:44.441+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:45.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:45.396+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:45.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:45.396+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:46.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:46.395+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:46.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:46.395+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:47.355 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:47.351+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:47.355 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:47.351+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:48.370 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:48.367+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:48.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:48.367+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:49.345 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:49.341+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:49.346 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:49.341+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:50.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:50.387+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:50.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:50.387+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:51.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:51.400+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:51.404 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:51.400+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:52.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:52.396+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:52.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:52.396+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:53.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:53.390+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:53.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:53.390+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:54.418 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:54.414+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:54.418 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:54.415+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:55.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:55.421+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:55.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:55.421+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:56.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:56.421+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:56.425 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:56.421+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:57.399 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:57.396+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:57.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:57.396+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:58.379 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:58.376+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:58.379 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:58.376+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:00:59.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:59.327+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:00:59.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:00:59.327+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:00.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:00.330+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:01:00.333 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:00.330+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:01.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:01.353+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:01:01.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:01.353+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:02.374 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:02.371+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:01:02.375 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:02.371+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:03.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:03.376+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:01:03.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:03.376+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:04.377 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:04.374+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:01:04.377 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:04.374+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:05.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:05.404+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:01:05.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:05.404+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:06.379 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:06.376+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:01:06.379 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:06.376+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:07.391 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:07.388+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:01:07.391 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:07.388+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:08.396 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:08.392+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:01:08.397 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:08.392+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:09.380 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:09.378+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:01:09.381 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:09.378+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:10.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:10.353+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:01:10.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:10.353+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:11.369 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:11.366+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T05:50:39.510324+0000 (oldest deadline 2020-06-27T05:50:59.510324+0000) 2020-06-27T06:01:11.369 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:11.366+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:12.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:12.355+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:13.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:13.327+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:14.288 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:14.285+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:15.307 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:15.305+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:16.351 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:16.348+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:17.391 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:17.385+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:18.416 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:18.413+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:19.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:19.381+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:20.421 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:20.418+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:21.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:21.397+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:22.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:22.401+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:23.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:23.380+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:24.382 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:24.377+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:25.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:25.355+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:26.398 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:26.395+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:27.390 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:27.387+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:28.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:28.427+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:29.400 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:29.394+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:30.403 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:30.400+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:31.358 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:31.355+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:32.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:32.319+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:33.351 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:33.348+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:34.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:34.346+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:34.349 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:34.346+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:35.308 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:35.305+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:35.308 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:35.305+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:36.351 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:36.349+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:36.352 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:36.349+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:37.353 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:37.350+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:37.353 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:37.350+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:38.303 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:38.301+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:38.304 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:38.301+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:39.336 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:39.333+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:39.336 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:39.333+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:40.356 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:40.353+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:40.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:40.354+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:41.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:41.382+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:41.385 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:41.382+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:42.391 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:42.389+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:42.411 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:42.389+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:43.423 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:43.421+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:43.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:43.421+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:44.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:44.405+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:44.408 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:44.405+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:45.447 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:45.445+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:45.447 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:45.445+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:46.487 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:46.485+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:46.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:46.485+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:47.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:47.532+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:47.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:47.532+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:48.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:48.518+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:48.521 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:48.518+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:49.538 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:49.535+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:49.538 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:49.535+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:50.532 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:50.530+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:50.533 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:50.530+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:51.534 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:51.532+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:51.535 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:51.532+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:52.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:52.560+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:52.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:52.560+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:53.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:53.573+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:53.576 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:53.574+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:54.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:54.564+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:54.567 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:54.564+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:55.552 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:55.549+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:55.552 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:55.549+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:56.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:56.505+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:56.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:56.505+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:57.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:57.496+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:57.499 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:57.496+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:58.545 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:58.541+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:58.545 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:58.541+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:01:59.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:59.586+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:01:59.590 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:01:59.586+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:00.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:00.633+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:00.636 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:00.633+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:01.650 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:01.647+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:01.651 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:01.647+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:02.670 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:02.667+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:02.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:02.667+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:03.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:03.661+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:03.665 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:03.661+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:04.638 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:04.634+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:04.638 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:04.634+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:05.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:05.658+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:05.671 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:05.658+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:06.645 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:06.642+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:06.646 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:06.642+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:07.631 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:07.628+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:07.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:07.628+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:08.594 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:08.591+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:08.594 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:08.591+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:09.613 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:09.609+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:09.613 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:09.609+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:10.629 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:10.626+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:10.630 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:10.626+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:11.657 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:11.654+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:11.657 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:11.654+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:12.669 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:12.665+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:12.669 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:12.665+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:13.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:13.640+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:13.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:13.640+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:14.606 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:14.603+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:14.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:14.603+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:15.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:15.577+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:15.580 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:15.577+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:16.540 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:16.537+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:16.541 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:16.537+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:17.495 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:17.492+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:17.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:17.492+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:18.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:18.504+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:18.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:18.504+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:19.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:19.510+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:19.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:19.510+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:20.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:20.479+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:20.483 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:20.479+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:21.520 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:21.517+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:21.520 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:21.517+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:22.527 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:22.524+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:22.527 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:22.524+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:23.564 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:23.561+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:23.565 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:23.561+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:24.585 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:24.581+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:24.585 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:24.581+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:25.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:25.611+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:25.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:25.611+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:26.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:26.605+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:26.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:26.605+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:27.657 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:27.654+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:27.658 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:27.654+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:28.699 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:28.695+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:28.699 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:28.695+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:29.705 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:29.702+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:29.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:29.702+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:30.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:30.709+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:30.712 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:30.709+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:31.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:31.751+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:31.754 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:31.751+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:32.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:32.725+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:32.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:32.725+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:33.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:33.728+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:33.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:33.728+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:34.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:34.775+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:34.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:34.775+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:35.793 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:35.790+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:35.794 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:35.790+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:36.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:36.823+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:36.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:36.823+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:37.859 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:37.856+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:37.860 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:37.856+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:38.903 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:38.899+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:38.904 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:38.899+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:39.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:39.901+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:39.911 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:39.901+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:40.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:40.860+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:40.864 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:40.860+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:41.889 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:41.885+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:41.890 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:41.885+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:42.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:42.897+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:42.901 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:42.898+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:43.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:43.867+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:43.870 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:43.867+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:44.873 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:44.870+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:44.873 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:44.870+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:45.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:45.848+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:45.851 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:45.848+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:46.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:46.816+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:46.819 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:46.816+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:47.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:47.782+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:47.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:47.782+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:48.834 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:48.832+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:48.835 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:48.832+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:49.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:49.830+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:49.833 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:49.830+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:50.868 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:50.865+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:50.868 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:50.865+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:51.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:51.817+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:51.822 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:51.818+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:52.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:52.821+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:52.824 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:52.821+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:53.865 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:53.862+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:53.865 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:53.862+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:54.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:54.824+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:54.827 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:54.824+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:55.779 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:55.777+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:55.780 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:55.777+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:56.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:56.768+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:56.771 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:56.768+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:57.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:57.772+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:57.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:57.772+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:58.784 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:58.782+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:58.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:58.782+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:02:59.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:59.773+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:02:59.778 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:02:59.773+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:00.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:00.797+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:00.800 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:00.797+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:01.806 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:01.804+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:01.807 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:01.804+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:02.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:02.796+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:02.799 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:02.797+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:03.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:03.785+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:03.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:03.785+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:04.761 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:04.759+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:04.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:04.759+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:05.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:05.729+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:05.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:05.729+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:06.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:06.741+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:06.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:06.741+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:07.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:07.763+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:07.766 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:07.763+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:08.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:08.750+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:08.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:08.750+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:09.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:09.773+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:09.775 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:09.773+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:10.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:10.793+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:10.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:10.793+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:11.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:11.807+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:11.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:11.807+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:12.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:12.787+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:12.790 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:12.787+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:13.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:13.765+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:13.767 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:13.765+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:14.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:14.786+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:14.789 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:14.786+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:15.795 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:15.793+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:15.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:15.793+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:16.773 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:16.771+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:16.774 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:16.771+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:17.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:17.724+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:17.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:17.724+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:18.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:18.724+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:18.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:18.724+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:19.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:19.713+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:19.716 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:19.714+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:20.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:20.760+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:20.762 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:20.760+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:21.760 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:21.757+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:21.760 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:21.757+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:22.713 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:22.711+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:22.714 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:22.711+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:23.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:23.661+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:23.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:23.661+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:24.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:24.641+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:24.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:24.641+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:25.626 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:25.623+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:25.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:25.623+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:26.678 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:26.662+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:26.679 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:26.662+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:27.643 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:27.640+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:27.644 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:27.640+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:28.640 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:28.637+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:28.641 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:28.637+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:29.634 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:29.628+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:29.635 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:29.628+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:30.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:30.660+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:30.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:30.660+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:31.702 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:31.699+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:31.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:31.699+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:32.750 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:32.747+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:32.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:32.747+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:33.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:33.784+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:33.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:33.784+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:34.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:34.833+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:34.837 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:34.833+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:35.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:35.853+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:35.856 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:35.853+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:36.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:36.860+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:36.863 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:36.860+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:37.828 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:37.825+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:37.829 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:37.825+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:38.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:38.811+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:38.814 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:38.811+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:39.847 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:39.844+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:39.848 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:39.844+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:40.810 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:40.807+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:40.811 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:40.807+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:41.787 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:41.784+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:41.788 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:41.784+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:42.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:42.765+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:42.772 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:42.765+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:43.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:43.727+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:43.731 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:43.727+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:44.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:44.738+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:44.741 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:44.738+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:45.718 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:45.715+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:45.719 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:45.715+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:46.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:46.725+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:46.728 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:46.725+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:47.681 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:47.678+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:47.682 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:47.678+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:48.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:48.661+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:48.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:48.661+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:49.651 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:49.648+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:49.651 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:49.648+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:50.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:50.605+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:50.609 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:50.605+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:51.637 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:51.634+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:51.638 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:51.634+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:52.600 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:52.597+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:52.601 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:52.597+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:53.588 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:53.585+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:53.588 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:53.585+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:54.602 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:54.600+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:54.603 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:54.600+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:55.570 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:55.567+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:55.570 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:55.567+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:56.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:56.585+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:56.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:56.585+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:57.613 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:57.611+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:57.614 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:57.611+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:58.599 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:58.596+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:58.600 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:58.596+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:03:59.617 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:59.614+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:03:59.618 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:03:59.614+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:00.622 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:00.619+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:00.623 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:00.619+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:01.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:01.617+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:01.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:01.617+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:02.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:02.586+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:02.589 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:02.586+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:03.639 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:03.636+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:03.639 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:03.636+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:04.598 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:04.595+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:04.598 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:04.595+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:05.624 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:05.621+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:05.624 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:05.621+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:06.623 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:06.620+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:06.623 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:06.620+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:07.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:07.617+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:07.620 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:07.617+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:08.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:08.624+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:08.627 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:08.624+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:09.663 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:09.660+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:09.663 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:09.660+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:10.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:10.700+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:10.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:10.700+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:11.709 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:11.707+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:11.710 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:11.707+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:12.729 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:12.726+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:12.730 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:12.726+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:13.752 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:13.749+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:13.752 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:13.749+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:14.742 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:14.739+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:14.743 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:14.739+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:15.726 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:15.724+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:15.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:15.724+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:16.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:16.750+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:16.753 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:16.750+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:17.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:17.793+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:17.796 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:17.793+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:18.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:18.836+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:18.840 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:18.836+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:19.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:19.865+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:19.869 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:19.865+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:20.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:20.896+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:20.900 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:20.896+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:21.925 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:21.922+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:21.925 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:21.922+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:22.945 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:22.942+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:22.948 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:22.942+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:23.939 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:23.936+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:23.939 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:23.936+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:24.977 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:24.975+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:24.978 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:24.975+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:26.026 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:26.023+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:26.027 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:26.023+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:27.075 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:27.073+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:27.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:27.073+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:28.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:28.063+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:28.066 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:28.063+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:29.057 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:29.055+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:29.058 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:29.055+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:30.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:30.013+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:30.016 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:30.013+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:31.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:31.039+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:31.042 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:31.039+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:32.064 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:32.062+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:32.064 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:32.062+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:33.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:33.083+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:33.086 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:33.083+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:34.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:34.050+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:34.053 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:34.050+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:35.090 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:35.088+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:35.091 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:35.088+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:36.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:36.109+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:36.113 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:36.109+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:37.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:37.114+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:37.117 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:37.114+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:38.122 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:38.120+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:38.122 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:38.120+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:39.129 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:39.127+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:39.130 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:39.127+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:40.116 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:40.114+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:40.116 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:40.114+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:41.141 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:41.138+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:41.141 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:41.138+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:42.131 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:42.129+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:42.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:42.129+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:43.162 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:43.160+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:43.163 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:43.160+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:44.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:44.136+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:44.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:44.136+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:45.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:45.176+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:45.178 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:45.176+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:46.200 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:46.198+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:46.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:46.198+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:47.187 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:47.184+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:47.188 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:47.184+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:48.184 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:48.181+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:48.184 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:48.181+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:49.224 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:49.222+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:49.225 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:49.222+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:50.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:50.255+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:50.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:50.255+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:51.215 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:51.212+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:51.215 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:51.212+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:52.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:52.261+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:52.263 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:52.261+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:53.248 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:53.245+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:53.249 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:53.245+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:54.260 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:54.257+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:54.260 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:54.257+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:55.226 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:55.223+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:55.226 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:55.223+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:56.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:56.231+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:56.235 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:56.231+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:57.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:57.206+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:57.209 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:57.206+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:58.172 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:58.168+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:58.172 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:58.168+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:04:59.191 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:59.187+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:04:59.191 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:04:59.187+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:00.215 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:00.212+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:00.215 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:00.212+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:01.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:01.243+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:01.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:01.243+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:02.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:02.241+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:02.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:02.241+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:03.246 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:03.243+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:03.246 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:03.243+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:04.240 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:04.237+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:04.241 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:04.237+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:05.239 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:05.236+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:05.240 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:05.236+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:06.198 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:06.195+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:06.198 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:06.195+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:07.238 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:07.235+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:07.239 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:07.235+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:08.221 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:08.218+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:08.221 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:08.218+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:09.246 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:09.243+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:09.246 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:09.243+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:10.265 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:10.262+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:10.266 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:10.262+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:11.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:11.247+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:11.251 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:11.247+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:12.234 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:12.231+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:12.234 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:12.231+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:13.268 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:13.265+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:13.268 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:13.265+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:14.318 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:14.315+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:14.318 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:14.315+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:15.270 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:15.267+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:15.270 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:15.267+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:16.279 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:16.276+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:16.280 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:16.276+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:17.300 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:17.297+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:17.300 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:17.297+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:18.257 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:18.254+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:18.258 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:18.254+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:19.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:19.247+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:19.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:19.247+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:20.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:20.215+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:20.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:20.215+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:21.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:21.215+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:21.218 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:21.215+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:22.268 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:22.264+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:22.268 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:22.265+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:23.266 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:23.263+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:23.266 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:23.263+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:24.233 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:24.230+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:24.234 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:24.230+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:25.272 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:25.269+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:25.272 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:25.269+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:26.244 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:26.239+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:26.245 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:26.239+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:27.262 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:27.259+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:27.262 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:27.259+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:28.273 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:28.271+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:28.274 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:28.271+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:29.273 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:29.270+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:29.274 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:29.270+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:30.301 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:30.298+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:30.301 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:30.298+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:31.322 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:31.320+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:31.323 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:31.320+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:32.359 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:32.357+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:32.360 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:32.357+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:33.352 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:33.349+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:33.353 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:33.349+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:34.378 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:34.375+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:34.378 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:34.375+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:35.393 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:35.391+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:35.394 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:35.391+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:36.363 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:36.360+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:36.363 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:36.360+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:37.412 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:37.409+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:37.413 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:37.409+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:38.430 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:38.427+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:38.431 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:38.427+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:39.395 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:39.392+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:39.396 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:39.392+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:40.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:40.421+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:40.424 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:40.421+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:41.437 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:41.435+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:41.438 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:41.435+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:42.487 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:42.484+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:42.488 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:42.484+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:43.449 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:43.447+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:43.450 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:43.447+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:44.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:44.439+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:44.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:44.439+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:45.395 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:45.392+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:45.395 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:45.392+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:46.443 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:46.441+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:46.444 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:46.441+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:47.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:47.437+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:47.441 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:47.437+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:48.439 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:48.436+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:48.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:48.436+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:49.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:49.449+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:49.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:49.450+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:50.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:50.476+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:50.479 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:50.476+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:51.462 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:51.459+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:51.463 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:51.459+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:52.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:52.439+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:52.442 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:52.439+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:53.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:53.402+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:53.405 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:53.402+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:54.453 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:54.449+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:54.454 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:54.449+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:55.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:55.493+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:55.496 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:55.493+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:56.507 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:56.505+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:56.508 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:56.505+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:57.489 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:57.486+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:57.490 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:57.486+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:58.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:58.473+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:58.476 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:58.473+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:05:59.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:59.433+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:05:59.436 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:05:59.433+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:06:00.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:00.480+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:06:00.482 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:00.480+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:06:01.438 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:01.435+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:06:01.438 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:01.435+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:06:02.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:02.414+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:06:02.417 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:02.414+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:06:03.438 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:03.436+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:06:03.438 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:03.436+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:06:04.401 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:04.399+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:06:04.402 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:04.399+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:06:05.397 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:05.395+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:06:05.397 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:05.395+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:06:06.362 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:06.360+0000 7fe5cbd8d700 -1 osd.0 31 heartbeat_check: no reply from 172.21.15.17:6806 osd.1 ever on either front or back, first ping sent 2020-06-27T06:01:13.869378+0000 (oldest deadline 2020-06-27T06:01:33.869378+0000) 2020-06-27T06:06:06.363 INFO:tasks.ceph.osd.0.smithi017.stderr:2020-06-27T06:06:06.360+0000 7fe5cbd8d700 -1 osd.0 31 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4134.0:3 1.2 1:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected e29) 2020-06-27T06:06:06.923 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-06-27T06:06:06.925 DEBUG:teuthology.task.console_log:Killing console logger for smithi017 2020-06-27T06:06:06.926 DEBUG:teuthology.task.console_log:Killing console logger for smithi017 2020-06-27T06:06:06.926 DEBUG:teuthology.exit:Finished running handlers